Robust Formation Control 
for Multiple Unmanned 
Aerial Vehicles 


Hao Liu « Deyuan Liu « Yan Wan 
Kimon P. Valavanis e Frank L. Lewis 


CRC Press 
Taylor & Francis Group 


Robust Formation 
Control for Multiple 
Unmanned Aerial 
Vehicles 


This book is based on the authors’ recent research results on formation 
control problems, including time-varying formation, communication delays, 
and fault-tolerant formation, for multiple UAV systems with high nonlineari- 
ties, parameter uncertainties, and external disturbances. 

Differentiating from existing works, this book presents a robust optimal 
formation approach to designing distributed cooperative control laws for a 
group of UAVs based on the linear quadratic regulator control method and 
the robust compensation theory. The proposed control method is composed 
of two parts: the nominal part to achieve desired tracking performance and 
the robust compensation part to restrain the influence of high nonlinearities, 
parameter uncertainties, and external disturbances on the global closed-loop 
control system. Furthermore, this book gives proof of their robust properties. 
The influence of communication delays and actuator fault tolerance can be 
restrained by the proposed robust formation control protocol, and the forma- 
tion tracking errors can converge into a neighborhood of the origin bounded 
by a given constant in a finite time. Moreover, this book provides details 
about the practical application of the proposed method to design formation 
control systems for multiple quadrotors and tail-sitters. Additional features 
include a robust control method that is proposed to address the formation 
control problem for UAVs, and theoretical and experimental research for the 
cooperative flight of the quadrotor UAV group and the tail-sitter UAV group. 

Robust Formation Control for Multiple Unmanned Aerial Vehicles is 
suitable for graduate students, researchers, and engineers in the system and 
control community, especially those engaged in the areas of robust control, 
UAV swarming, and multi-agent systems. 


Automation and Control Engineering 


Series Editors: 
Frank L. Lewis, Shuzhi Sam Ge, and Stjepan Bogdan 


Adaptive and Fault-Tolerant Control of Underactuated 
Nonlinear Systems 
Jiangshuai Huang and Yong-Duan Song 


Discrete-Time Recurrent Neural Control 
Analysis and Application 
Edgar N. Sanchez 


Control of Nonlinear Systems via PI, PD and PID 
Stability and Performance 
Yong-Duan Song 


Multi-Agent Systems 
Platoon Control and Non-Fragile Quantized Consensus 
Xiang-Gui Guo, Jian-Liang Wang, Fang Liao, and Rodney Swee Huat Teo 


Classical Feedback Control with Nonlinear Multi-Loop Systems 
With MATLAB® and Simulink®, Third Edition 
Boris J. Lurie and Paul Enright 


Motion Control of Functionally Related Systems 
Tarik Uzunovié and Asif Sabanovié 


Intelligent Fault Diagnosis and Accommodation Control 
Sunan Huang, Kok Kiong Tan, Poi Voon Er, and Tong Heng Lee 


Nonlinear Pinning Control of Complex Dynamical Networks 
Edgar N. Sanchez, Carlos J. Vega, Oscar J. Suarez, and Guanrong Chen 


Adaptive Control of Dynamic Systems with 
Uncertainty and Quantization 
Jing Zhou, Lantao Xing, and Changyun Wen 


Robust Formation Control for Multiple Unmanned Aerial Vehicles 
Hao Liu, Deyuan Liu, Yan Wan, Kimon P. Valvanis, and Frank L. Lewis 


For more information about this series, please visit: https://www.crcpress. 
com/Automation-and-Control-Engineering /book-series/CRCAUTCONENG 


Robust Formation 
Control for Multiple 
Unmanned Aerial 
Vehicles 


Hao Liu, Deyuan Liu, Yan Wan, 
Kimon P. Valavanis, and Frank L. Lewis 


CRC Press 
Taylor & Francis Group 
Boca Raton London New York 
e 
orma business 


First edition published 2023 
by CRC Press 
6000 Broken Sound Parkway NW, Suite 300, Boca Raton, FL 33487-2742 


and by CRC Press 
4 Park Square, Milton Park, Abingdon, Oxon, OX14 4RN 


CRC Press is an imprint of Taylor & Francis Group, LLC 
© 2023 Hao Liu, Deyuan Liu, Yan Wan, Kimon P. Valavanis, Frank L. Lewis 


Reasonable efforts have been made to publish reliable data and information, but the author and 
publisher cannot assume responsibility for the validity of all materials or the consequences of 
their use. The authors and publishers have attempted to trace the copyright holders of all material 
reproduced in this publication and apologize to copyright holders if permission to publish in this 
form has not been obtained. If any copyright material has not been acknowledged please write and 
let us know so we may rectify in any future reprint. 


Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, 
transmitted, or utilized in any form by any electronic, mechanical, or other means, now known 
or hereafter invented, including photocopying, microfilming, and recording, or in any information 
storage or retrieval system, without written permission from the publishers. 


For permission to photocopy or use material electronically from this work, access www.copyright. 
com or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 
01923, 978-750-8400. For works that are not available on CCC please contact mpkbookspermissions@ 
tandf.co.uk 


Trademark notice: Product or corporate names may be trademarks or registered trademarks and are 
used only for identification and explanation without intent to infringe. 


ISBN: 9781032149400 (hbk) 
ISBN: 9781032150246 (pbk) 
ISBN: 9781003242147 (ebk) 


DOI: 10.1201/9781003242147 


Typeset in Palatino 
by codeMantra 


Contents 


Preface necne nemen Mar Lese wh accede ca pe oes Seen duete dle det ateu dec bea a ix 
AUNO S noeh mendi ae nec ne inerenti ER nete men ere xi 
1. Introduction and Background....................... sss eee 1 
1M EE eor —X—X—— abanar 1 
1.2 Literature Review on Formation Control for UAVSs.......................... 2 
1.211 UAV Formation Experiment................. sss 2 
1.2.2 Research on UAV Formation Control Method..................... 7 
1.3 Formation PlatfOFm.. eret ee Ene RUE e ei ada pata 11 
1.8.4 Introduction of Quadrotor Formation Hardware 
yo ————— a 11 
1.3.2. Airborne Sensors. sias a Ca auda dă did esent 12 
1.3 Indoor Positioning System Based on 
UWDB-Iechnology «tette romeo eR 13 
1.3.4 Communication Module.......................: sse 14 
L4 - Preview Of Chapters: «esee eene m aie au atata 15 
2. Robust Formation Control for Multiple Quadrotors with 
Nonlinearities and Disturbances ...................... eese 17 
241. Introduction. siae cni nad E M et d etsi 17 
2.2 Preliminaries and Problem Formwulation.............................. sss 19 
224.  Quadrotor Model... eee 19 
2.22  Preliminaries on Graph Theory....................... sss 22 
22.39 Problem: Formulation... niani 22 
2.3 Formation Protocol Design and System Analysis.......................... 24 
2.3.1 Position Controller Design ................... sse 24 
2.3.2 -Attitude Controller Design... 26 
2:9:9- System Analysis «cinese ceda eat ea due aene pe tust 27 
2.4 Numerical Simulation Results ......................... sse 31 
25. 'GQornclüsion.. iei ddan c med dada acad 36 
3. Robust Formation Trajectory Tracking Control for 
Multiple Quadrotors with Communication Delays ............................. 37 
Sil Introduction se nuca caca pt za eet ad Hec i RC a al cases 37 
3.2 Preliminaries and Problem Formulation.............................. sss 39 
32.1 ‘Quadrotor Model... aient 39 
3.22 . Problem Formulation ........ n creen tees 41 


vi 


Contents 

9,9 Controller Designer canada e atatea 42 

3.3.1 Position Controller Design... eee eee eee 42 

3.3.2 Attitude Controller Design... 45 

3.4 Robustness Property Analysis... eee nissens 46 

3.5 Experimental, Results seca cepe sa ataca taina pa e ieri iie idee 51 

SiO “COMGIUSION scie seste ceia E E ea al a ana e a it 56 

. Robust Formation Tracking Control for Multiple Quadrotors 

Subject to Switching Topologies ................... sse 59 

AV: - INTOUCLION iii aa ineaca ceea aia poi aa ea ia it na aaa 59 

4.2 Preliminaries and Problem Description... eee eee 61 

421 Graph DheOry «iscritti peperere ttn 61 

4.2.2° „System Modell cune eine eiii Wendt 62 

42.3 Problem Description saraca incarnata enma aaa 64 

43 Formation Control Protocol Design .... cecene eee e enenneeeeeee 64 

4.3.1 Position: Controller Design ...................... sse 64 

4.3.2 Attitude Controller Designissa 66 

44. Global System Analysis... eee eee eere rta 67 

4.5, “Simulation Results... oerte eee etn eene diens 70 

46 - COMCIUSION E —— —————— 75 
. Robust Time-Varying Formation Control for Tail-Sitters in 

Flight Mode Transitions sinnn tenente ceres 77 

b.) ^ IntroductiOEi scie ei inegal da Co itn d id ia 77 

5.2 Preliminaries and Problem Statement ...................... sss 79 

5.2.1 Model of Tail-Sitter Aircraft... 79 

5.22 Control Problem Statement assosieres 83 

5.3 Robust Formation Controller Design ........................ sss 84 

5.3.1 Trajectory Tracking Controller Design ............................... 85 

5.3.2 Attitude Controller Design... 86 

5.4 Robust Property Analysis... onere treten tnos 87 

59  Simulătion Results: recete ierit a 92 

SK Sedet osia ea pa ataca aaa ca ca nts 95 
. Robust Fault-Tolerant Formation Control for Tail-Sitters in 

Aggressive Flight Mode Transitions ............cecee nenea cneneneneeceenen nene eeea 99 

SEN ANETOAUCHON, sic sees ascet 0 at ea ada ci nets 99 

6.2. Problem Formulation... tec aa na i iat aaa can a 101 

6.21. Aircraft Body «uio eee cete psi pene 101 

6.22 Dynamic Motion Equations ................sseeeeeeeeene 102 

6.2.3.  Actuatoră e ——M 106 


6:24- Problem Statement... erret aaa 107 


Contents vii 
6.9. ‘Robust Controller Design... «eie eie nitent ede 108 
6.3.1 Outer Position Controller Design .....................sssss 108 

6.3.2 Inner Attitude Controller Design... 109 

6.4 Robust Property Analysis... eee siete ritenere iin 110 

6.5 Simulation Results... ee etie eitis ripe ione 114 

6.6: COMCIUSION EE —— M 119 
BUDO Sa Ply e nnm 121 
IND OX E d 129 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 


Preface 


Unmanned Aerial Vehicles (UAVs) have various applications, such as surveil- 
lance, border patrol, building exploration, mapping, and inspection, where 
the operating environments can be dangerous and inaccessible. In practical 
applications, it is difficult for a single UAV to perform complex tasks, due to 
the limited endurance, load capacity, and coverage radius. Compared to a 
single aerial vehicle, multiple UAVs are capable to perform complex tasks, 
simultaneously, which can increase efficiency and provide redundancy 
against individual failures. Therefore, formation flight of a team of UAVs has 
attracted considerable attention in both the military and civil fields over the 
past two decades. It is significant for achieving the desired formation flying 
to design robust formation controllers. 

There are multiple challenges for the robust formation controller design 
of a group of UAVs. The dynamics of UAVs is highly nonlinear and coupled. 
Multiple uncertainties such as unmodelled uncertainties, parametric per- 
turbations, and external disturbances can affect the tracking performance 
of the flight control system. Furthermore, in practical applications, such as 
source seeking and target enclosing, the UAV formation is required to track 
the desired trajectory to perform the tasks while keeping the desired time- 
varying formation. Moreover, individual UAVs cooperate with others through 
communication for information sharing. During the information exchange, 
time delays inevitably exist, which may degrade the control performance of 
the formation and even destabilize the entire system. In addition, each UAV 
may be subject to certain actuator failures. In the framework of formation 
control, the actuator failure in an individual UAV can spread over neighbor- 
ing UAVs through the interaction topology and affect the performance of 
the whole system. All of the above issues make it difficult to achieve desired 
formation control performance for a group of UAVs. 

This book is based on the authors’ recent research results on formation 
control problems, including time-varying formation, communication delays, 
and fault-tolerant formation, for multiple UAV systems with high nonlineari- 
ties, parameter uncertainties, and external disturbances. Different from the 
existing works, we present a robust optimal formation approach to design 
distributed cooperative control laws for a group of UAVs, based on the lin- 
ear quadratic regulator (LOR) control method and the robust compensation 
theory. The proposed control method is composed of two parts: the nominal 
part to achieve desired tracking performance and the robust compensation 
part to restrain the influence of high nonlinearities, parameter uncertain- 
ties, and external disturbances on the global closed-loop control system. 
Furthermore, this book gives the proof of robust properties. The influence 
of communication delays and actuator fault tolerance can be restrained by 


ix 
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the proposed robust formation control protocol, and the formation tracking 
errors can converge into a neighborhood of the origin bounded by a given 
constant in a finite time. Moreover, this book provides details about the prac- 
tical applications of the proposed method to design formation control sys- 
tems for multiple quadrotors and tail-sitters. 

The main features of this book include a robust control method proposed 
to address the formation control problem for UAVs, and theoretical and 
experimental research for the cooperative flight of the quadrotor UAV group 
and the tail-sitter UAV group. This book is suitable for graduate students, 
researchers, and engineers in the system and control community, especially 
those engaged in the area of robust control, UAV swarming, and multi-agent 
systems. 

We are grateful to Beihang University for providing resources for our 
research work. We also gratefully acknowledge the support of our research 
by the National Natural Science Foundation of China (grant nos. 61873012, 
61503012, and 61633007), China Postdoctoral Science Foundation (grant nos. 
2021M700336), and National Science Foundation (grant nos. 1730675 and 
1714519). Finally, we would like to thank the entire team at Taylor & Francis 
Group for their cooperation and encouragement in bringing out the work in 
the form of a monograph. 
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Introduction and Background 


1.1 Background 


In the past decades, multi-agent cooperative control has become the frontier 
of artificial intelligence. The objective of multi-agent control is to divide the 
complex system into several small individuals, which can exchange infor- 
mation and works cooperatively. As a typical agent platform, an unmanned 
aerial vehicle (UAV) is widely used in the research of multi-agent coopera- 
tive control. In particular, the formation control problem for a group of UAV 
systems has attracted significant attention recently in multiple fields, such 
as robotics, aerospace, and wireless communication. UAV formation has 
been widely used in multiple missions, such as persistent surveillance, drag 
reduction, exploration, and telecommunication relay. With the increasing 
demand for multiple UAV systems to complete complex tasks cooperatively, 
it is important to realize formation flight in a robust manner for these multi- 
agent systems. Multiple studies have been conducted to deal with the forma- 
tion control problems in a team of unmanned vehicles. 

In practical applications, it is difficult for a single UAV to perform com- 
plex tasks, due to the limited endurance, load capacity, and coverage radius. 
Distributed formation cooperative control can effectively organize multiple 
UAVs to accomplish various tasks, which effectively improve the operating 
radius and greatly enhance the application prospects of UAVs in various 
fields, such as border patrol, search and exploration, forest fire monitoring, 
and communication relay. 

Rotary-wing UAV has the advantages of simple aerodynamic shape, ver- 
tical take-off and landing, low price, and so on, which is widely used in 
multiple fields. In recent years, rotary-wing UAV is also favored by military 
and civil fields. Because of its strong mobility, small size, and simple struc- 
ture, rotary-wing UAV is used in the military field for indoor anti-terrorism 
reconnaissance and military strike and in the civil field for cluster perfor- 
mance, aerial photography, and news broadcast. In recent years, with the 
development of multi-agent research, rotary-wing is also used as a typical 
experimental platform for collaborative control algorithm research. 
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However, there are multiple challenges to the robust formation controller 
design of a group of UAVs. The dynamics of UAVs are highly nonlinear and 
coupled. Multiple uncertainties such as unmodeled uncertainties, paramet- 
ric perturbations, and external disturbances can affect the tracking perfor- 
mance of the flight control system. Furthermore, in practical applications, 
such as source seeking and target enclosing, the UAV formation is required 
to track the desired trajectory to perform the tasks while keeping the desired 
time-varying formation. Moreover, individual UAV cooperates with others 
through communication for information sharing. During the information 
exchange, time delays are inevitable, which may degrade the control perfor- 
mance of the formation and even destabilize the entire system. In addition, 
each UAV may be subject to certain actuator failures. In the framework of 
formation control, the actuator failure in an individual UAV can spread over 
neighboring UAVs through the interaction topology and affect the perfor- 
mance of the whole system. All of the above issues make it difficult to achieve 
desired formation control performance for a group of UAVs. Therefore, the 
formation control for multiple UAVs needs to be solved first. 


1.2 Literature Review on Formation Control for UAVs 
1.2.1 UAV Formation Experiment 


At present, researchers have made lots of achievements in UAV formation 
research, but most of them are mainly theoretical and simulation verifica- 
tion. In the actual formation flight experiment, we should not only consider 
the appropriate formation control method but also address the problems of 
information exchange, coordination, positioning and navigation, data calcu- 
lation, and analysis among UAVs. This section mainly introduces the main 
research results of UAV formation flight experiments. 

A group of YF-22 UAVs were designed and manufactured by the University 
of West Virginia for the experimental flight research to verify the formation 
control algorithm [1]. The formation control method was the classical leader- 
following method. In the formation flight experiment, the ground operator con- 
trolled the leader UAV through radio equipment, while the follower kept the 
formation and followed the position and direction of the leader (Figure 1.1). 

Three quadrotor UAVs were used in the experiment of the University of 
Macau to perform the formation trajectory tracking flight experiment based 
on the leader-following strategy [2]. The formation experiment was based 
on the rapid prototyping and testing architecture in the MATLAB/Simulink 
environment, which integrated navigation data from a vicon motion capture 
system with 12 high-speed cameras, control algorithms, and communica- 
tions with three radio-controlled quadrotors. During the experiment, the 
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FIGURE 1.1 
Two YF-22 UAVs from the University of West Virginia perform leader-following formation [1]. 


leader quadrotor tracked the "8"-shaped trajectory and formed a triangle 
formation with the other two quadrotors to complete the formation mission 
and trajectory tracking. 

Scholars from the School of Mechanical Engineering, Tokyo University, 
Japan, proposed a model prediction formation control method. Three small 
quadrotor UAVs were used for anti-collision formation control experiments 
[3]. In order to achieve formation control, the consensus control method was 
introduced into the model predictive control to maintain the formation of 
three quadrotors in the experiment. In the experiment, three-dimensional 
(3D) static cameras were used to obtain the position and attitude information 
of quadrotors in formation flight. All 3D static cameras were connected to 
one PC, which broadcasted the measurement data. Multiple PCs equaled to 
the number of UAVs were connected to the measurement PC through wire- 
less network. Each controller obtained the current state information from the 
measurement PC and the predicted state information from other controllers 
to complete the distributed formation control. 

The UAV research team of the Department of Electrical and Computer 
Science, National University of Singapore, has completed the formation 
experimental research on two unmanned helicopters named “Helion” and 
“Shelion” [4]. The formation adopted the classic leader-following formation 
strategy, "Helion" as the leader; "Sherion" received the leader's information 
to generate its own formation instructions. The communication between 
the two UAVs was completed through WiFi. The robust tracking control 
and leader-following formation control were combined to form the control 
method of formation system. The formation flight mission of two UAVs form- 
ing formation and tracking trajectory was completed (Figure 1.2). 
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FIGURE 1.2 
Formation experiment of two unmanned helicopters of the National University of Singapore [4]. 


Kumar's team of the University of Pennsylvania in the United States com- 
pleted the indoor formation flight experiment with multiple micro quadrotor 
UAVs [5]. In the formation experiment, a vicon motion capture system was 
used to complete the indoor positioning of quadrotor UAVs. The ground sta- 
tion obtained the positioning information, ran the formation controller, and 
sent the formation command to each quadrotor through ZigBee module to 
complete the formation flight control. The team accomplished the central- 
ized cluster flight experiment, that is, the centralized processing of aircraft 
information was completed in the ground station, and the formation control 
command was sent to each aircraft from the ground station to complete the 
centralized formation flight. The team has successively realized the formation 
flight of 20 micro UAVs through vicon system navigation [6] and achieved the 
formation experiment of up to 33 micro UAVs’ switching formation through 
ultra-wideband (UWB) indoor positioning technology [7]. 

The research group of LIS Laboratory of the Federal Institute of Technology 
in Lausanne, Switzerland, has realized the formation flight experiment of 
ten fixed-wing UAVs depended on swarm behavior [8]. The main purpose 
of the formation experiment was performed to study the influence of com- 
munication radius on flight stability. Each UAV completed autonomous flight 
navigation through a global positioning system (GPS) positioning, and each 
UAV communicated with each other through WiFi. Through the behavior- 
based formation strategy, the UAVs in the formation simulated the movement 
process of birds, fish, and other groups, and each UAV can only obtain the 
information of the surrounding individuals. This experiment verified that 
the formation strategy based on behavior was feasible, but there was no fur- 
ther research on other problems in formation flight (Figures 1.3-1.5). 
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FIGURE 1.3 
University of Pennsylvania 20 Mini Quad rotor indoor formation flight [6]. 


FIGURE 1.4 
University of Pennsylvania 33 micro quadrotors switching formation flying [7]. 


South Korea’s Gwangju Academy of Science and Technology has imple- 
mented a distributed formation flight experiment based on the distance 
using quadrotor UAVs [9]. In the formation experiment, the leading UAV flies 
at a constant reference speed, while the other following UAVs do not know 
the constant speed but use the adaptive method to estimate the reference 
speed. In formation, each UAV uses GPS positioning and its own inertial 
measurement unit data fusion to transform the global information into the 
local information of each aircraft through a rotation matrix. Each aircraft can 
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FIGURE 1.5 
Flight experiment of ten fixed-wing UAV formation at Lausanne Federal Institute of 
Technology [8]. 


First follower 


Follower 


FIGURE 1.6 
Distance-based distributed formation of three quadrotor UAVs of the Gwangju Institute of 
Science and Technology [9]. 


only obtain local information in formation flight, so as to realize distributed 
formation (Figure 1.6). 

The team of School of Automation of Tsinghua University used the forma- 
tion strategy based on consensus to realize the experiments of autonomous 
formation and time-varying formation of quadrotor UAVs [10]. In the experi- 
ment, a GPS system was used to locate the positioning of each UAV, ZigBee 
module was used to accomplish the wireless communication between UAVs, 
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and a consensus formation controller was used to complete the formation 
flight of UAVs in different situations, such as fixed communication topol- 
ogy, switching topology, and time varying. The UAV team of School of 
Automation, Beijing University of Aeronautics and Astronautics, has com- 
pleted the experimental study of multi-quadrotor UAV formation based on 
the switching topology method [11]. In the experiment, the leader received the 
reference trajectory command from the ground, and the followers formed a 
time-varying formation and followed the leader's state. Four quadrotor UAVs 
were used to complete the formation experiments under different conditions, 
such as time-varying formation, formation containment, and so on. 

Using the formation control method based on the artificial potential 
field method, the UAV team of Harbin Institute of Technology carried out 
the formation flight experiment indoors and achieved the formation keeping, 
formation switching, and formation trajectory tracking [12]. In the experi- 
ment, the formation control command was sent to each UAV through the 
robot operating system, and the information exchange between adjacent 
UAVs was completed (Figures 1.7-1.9). 


1.2.2 Research on UAV Formation Control Method 


In recent decades, UAV formation control has been widely concerned by 
scholars. However, the UAV control method design is subjected to the fol- 
lowing problems: first, in order to better match the characteristics of the UAV 
in the actual flight, the UAV dynamic equation should adopt the underactu- 
ated, nonlinear, and coupled model. Second, there are unmodeled dynamics, 
parameter perturbations, and external disturbances in the practical appli- 
cation of UAV. Finally, there are communication delays between UAVs and 


FIGURE 1.7 
The autonomous formation experiment of UAV in automation college of Tsinghua University [10]. 
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FIGURE 1.8 
Formation flight experiment of School of Automation, Beijing University of Aeronautics and 
Astronautics [11]. 


FIGURE 1.9 
Formation experiment of Harbin Institute of Technology based on the artificial potential field 
method [12]. 


ground stations during formation flight. All these factors bring challenges to 
UAV formation control. 

In [13-31], the cooperative formation control for a group of rotorcraft 
UAVs was investigated. In [13-16], formation control problems for a group 
of UAVs based on the leader-follower method were studied. In [13], a hybrid 
supervisory control method was proposed, which formed through a supervi- 
sory controller, maintained the achieved formation, and realized the forma- 
tion flight of 3-degrees-of-freedom (3-DOF) UAVs. However, in the process 
of controller design, only the simplified translation dynamics were consid- 
ered in the dynamic model, and the rotation dynamics were not considered. 
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A linear control law based on leader-follower formation was proposed in 
[14], which considered the translation and rotation dynamics. However, the 
nonlinear dynamics were simplified to linear systems by feedback lineariza- 
tion. A finite time formation control method was proposed in [15], but the 
complex rotational dynamics of each quadrotor in the formation was simpli- 
fied. In [16], the suboptimal controller was proposed to solve the problem of 
parameter uncertainty and external disturbance suppression in the forma- 
tion process. The UAV model of formation adopted a nonlinear model, but 
the stability of the whole closed loop under the drive formation system was 
not further proved, and the control method proposed cannot suppress the 
interference in the whole frequency domain. In [17], the behavior-based for- 
mation method was studied for the coordinated control of UAVs with prior- 
ity tasks in obstacle areas. However, in the design of the formation controller, 
only translation dynamics was considered for each UAV, and the stability of 
the whole closed-loop system was not further analyzed. The control scheme 
based on potential field theory was discussed in [18, 19]. Among them, the 
UAV model was simplified to the second-order nonlinear model by feedback 
linearization. Furthermore, the authors proved the stability and regarded the 
formation UAV system as a large-scale interconnected linear system to calcu- 
late the value of the formation gain. In [20], the authors proposed formation 
control strategies based on navigation follow-up, behavior control, and vir- 
tual structure, which can be unified in the general framework based on the 
consensus control method. In [21-26], the formation coordination problem of 
quadrotors was investigated by using a formation strategy based on the con- 
sensus method. In [21], a complete nonlinear model was adopted to design 
the controller, but the stability analysis of the underactuated system was not 
complete. In [22, 23], a robust distributed formation control method for a 
group of 3-DOF helicopters was studied. However, in the research of trajec- 
tory tracking, the dynamics of the underactuated system with uncertainties 
was not considered. In [24], a distributed formation method of quadrotors 
based on nonsmooth second-order consensus control was proposed, but the 
stability of the nonlinear closed-loop system of the underactuated UAV was 
not proved. In [25], an adaptive formation control method based on the con- 
sensus strategy was proposed to solve the parameter perturbation problem 
in the whole closed-loop control system. 

In addition, some methods to solve the problem of time delay in formation 
control are also mentioned in many literatures. In [26], a formation control 
method based on model predictive control was proposed, and the process- 
ing method of communication delay in formation was discussed. This con- 
trol strategy can find a feasible approximate optimal control sequence with 
short and constant delay in the formation process. In [27], aiming at the com- 
munication delay problem of a class of underactuated systems, a formation 
method based on singularity free extraction algorithm was proposed, and 
the control schemes with constant communication delay and time-varying 
communication delay were given, respectively. In addition, the stability of 
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the closed-loop system was proved by the Lyapunov method. In [28], a neigh- 
borhood feedback control method was proposed to reduce the communica- 
tion delay between different individuals in the formation. In addition, it was 
proved that the formation consensus was asymptotically convergence, and 
an estimate of the convergence rate was given. 

When performing more complex formation tasks, such as formation 
encirclement and target source search, compared with the time-invariant 
formation, the time-varying formation is more flexible and conducive to 
the implementation of complex tasks. In time-varying formation, because 
the communication distance between UAVs is limited, the method of 
switching communication topology is more conducive to the time-varying 
formation task. It was proposed in [29] that the design of the formation con- 
trol method with time-varying formation and switching communication 
topology was more challenging than that with the fixed formation and fixed 
communication topology. In [30], a hierarchical controller based on backstep- 
ping control was proposed to realize the switching communication topology 
formation flying of a group of UAVs. However, the formation is partially time 
varying, that is, the velocity components of all UAVs must be the same in 
the formation process. However, in practical applications, many situations 
require different velocity components of UAV, such as rotating formation. In 
[31], the problem of time-varying formation based on consensus was stud- 
ied. The necessary and sufficient conditions for the UAV group system to 
realize time-varying formation were given, and the explicit expression of 
time-varying formation center function was designed. 

In the complex flight environment, several faults inevitably occur in UAVs, 
such as aging of electronic components, sensor failure, and actuator dam- 
age. These faults may reduce the stability of the control system. At present, 
several scholars have carried out works on fault-tolerant control technology. 
In [32], a fault-tolerant cooperative control strategy was proposed for a team 
of UAVs and unmanned ground vehicles in the presence of actuator faults. 
In [33], a fault-tolerant method for stabilization and navigation of 3D het- 
erogeneous formations was proposed based on the model predictive control 
method. In [34], the problem of safe control for the trailing UAVs against actu- 
ator faults and input saturation was investigated. The external disturbances 
and internal actuator faults are estimated by using disturbance observers, 
and a backstepping control law was developed. In [35], a cooperative control 
problem for a multi-quadrotor system with quadrotor actuator faults was 
investigated. The extra cooperative controllers based on a potential-like func- 
tion were used to make the faulty ones leave the formation without colliding 
with others. 

Although scholars have done a lot of research on UAV formation control, 
UAVs in practical formation flight are subjected to nonlinear and coupling, 
parameter perturbation, communication delay, actuators faults, and exter- 
nal disturbances. It is significant to improve the robustness of the formation 
flight system by considering these factors simultaneously. Therefore, robust 
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formation control methods and formation experiments for UAVs are worthy 
of further research. 


1.3 Formation Platform 
1.3.1 Introduction of Quadrotor Formation Hardware System 


The diagram of the quadrotor used in this book is shown in Figure 1.10. The 
diagonal distance of the quadrotor is 92mm, and the mass is 37 g. 

During the flight, the four rotors of the quadrotor are distributed in an 
^X" shape. The two rotors at the lower left corner (No. 1) and the upper right 
corner (No. 3) rotate counterclockwise, and the two rotors at the upper left 
corner (No. 4) and the lower right corner (No. 2) rotate clockwise. When the 
sum of the lift generated by the rotation of the four rotors is equal to the 
gravity of the quadrotor, the quadrotor remains hovering. At the same time, 
the speed of four rotors increases or decreases to realize the vertical lifting 
movement. Rotors 1 and 2 accelerate (decelerate) and rotors 3 and 4 deceler- 
ate (accelerate) to realize the pitching motion of the quadrotor. Rotors 1 and 3 
accelerate (decelerate) and rotors 2 and 4 decelerate (accelerate) to realize the 
yaw motion of the quadrotor. Rotors 1 and 4 accelerate (decelerate) and rotors 
2 and 3 decelerate (accelerate) to realize the rolling motion of the quadrotor. 

The quadrotor generates control input through four motors, but it has 
three translational degrees of freedom (laternal, longitudinal, and height) 
and three rotational degrees of freedom (pitch, yaw, and roll). Therefore, the 
quadrotor is an underactuated system with four inputs and six outputs. 


FIGURE 1.10 
The diagram of a quadrotor. 
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FIGURE 1.11 
Hardware diagram of quadrotor formation. 


In the formation of quadrotors, each quadrotor needs to obtain its own 
position, attitude, independent control, and communicate with neighbor 
quadrotors and ground station. In addition, the ground software needs to 
record the flight data of each UAV in the formation flight in real time. As 
shown in Figure 1.11, the hardware composition of the formation system of 
the quadrotor is depicted. 


1.3.2 Airborne Sensors 


The airborne sensors of the quadrotor are mainly attitude sensors, includ- 
ing a three-axis accelerometer to detect gravity and acceleration, a three-axis 
gyroscope to detect body angular velocity, and a three-axis electronic com- 
pass to detect geomagnetic direction. The laser sensor is responsible for the 
accurate positioning of the height direction. The optical flow sensor obtains 
the horizontal motion information and calculates the relative displacement 
in X-Y direction. Positioning tag mainly completes indoor positioning and 
navigation based on UWB, information transmission between tag and posi- 
tioning base station, and indoor positioning of a quadrotor. The indoor posi- 
tioning system based on UWB technology will be introduced in more detail 
in the next section. 
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1.3.3 Indoor Positioning System Based on UWB Technology 


This monograph mainly completes the formation flight experiment of 
the quadrotor indoor; indoor positioning is the premise of the formation 
experiment of quadrotors. At present, there are many kinds of indoor 
positioning systems; this book mainly uses the indoor positioning system 
based on UWB technology to complete the indoor positioning of quadrotor 
formation. 

The indoor positioning system based on UWB technology mainly includes 
positioning base station and positioning label. The positioning base station 
is built in the field where a formation flight experiment is needed, and the 
quadrotor carries the positioning tag, which is used to complete the com- 
munication between the positioning tag and the positioning base station. 
Figure 1.12 is the schematic diagram of the construction of the experimental 
positioning system. Six positioning base stations are arranged in the indoor 
environment, and the time difference of arrival (TDOA) algorithm is adopted 
[27]. The distance between the positioning tag carried by the quadrotor and 
different base stations is different, and the time for the signal sent by the 
same tag to reach different base stations is different, resulting in the “time 
difference of arrival” of the arrival signal at different times. In this book, the 
TDOA of the tag signal received by different base stations is used to calculate 
the location of the positioning tag. 

In the part of this experiment, due to the influence of UWB positioning 
technology, such as positioning tag and random interference of base sta- 
tion communication, the positioning coordinates of quadrotor calculated 
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FIGURE 1.12 
Schematic diagram of an indoor positioning system. 
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FIGURE 1.13 
Schematic diagram of the indoor positioning system in the experiment. 


have errors, which affect the precise positioning and navigation of quadro- 
tor. In order to improve the positioning accuracy in the formation process, 
the positioning and navigation of the quadrotor formation process are com- 
pleted by the indoor positioning system based on UWB technology and opti- 
cal flow and laser module, and three parts of data fusion are completed by 
a Kalman filter and a complementary filter, so that the positioning accuracy 
of the quadrotor formation process is more accurate, reaching centimeter- 
level positioning error. The positioning system built during the experiment 
is shown in Figure 1.13. White circles indicate the location of each positioning 
base station. 


1.3.4 Communication Module 


Due to the distributed formation task, each UAV in the formation cannot 
obtain the global information but obtain its own formation instructions and 
the formation information of its neighbors. The UAV communicates with the 
ground station and its neighbors through the 2.4GHz wireless communica- 
tion module. During the flight, the UAV can send real-time position infor- 
mation to the ground station through the wireless communication module, 
and the communication network between the UAVs can also be completed 
through this communication module. 
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1.4 Preview of Chapters 


In this monograph, we address the formation control problems, including 
time-varying formation, communication delays, fault-tolerant formation, for 
multiple UAV systems with highly nonlinear and coupled parameter uncer- 
tainties, and external disturbances. Differentiating from existing works, we 
present a robust optimal formation approach to design distributed coopera- 
tive control laws for a group of UAVs, based on the linear quadratic regulator 
control method and the robust compensation theory. The proposed control 
method is composed of two parts: the nominal part to achieve desired track- 
ing performance and the robust compensation part to restrain the influence 
of highly nonlinear and strongly coupled parameter uncertainties and exter- 
nal disturbances on the global closed-loop control system. Furthermore, this 
book gives the proof of robust properties. The influence of communication 
delays and actuator fault tolerance can be restrained by the proposed robust 
formation control protocol, and the formation tracking errors can converge 
into a neighborhood of the origin bounded by a given constant in a finite 
time. Moreover, this book provides details about the practical application 
of the proposed method to design formation control systems for multiple 
quadrotors and tail sitters. 

This monograph consists of nine chapters. A brief introduction of these 
chapters is given as follows. 

Chapter 1 introduces the background of formation control for multiple 
UAVs and the research of UAV formation control experiments and control 
methods, and the chapter arrangement of this book. 

Chapter 2 investigates the robust formation control problem for a group 
of quadrotors subject to underactuation, high nonlinearities, and couplings. 
A distributed robust controller is developed. Theoretical analysis and 
simulation studies of the formation of multiple uncertain quadrotors are also 
presented to validate the effectiveness of the proposed formation control 
scheme. 

Chapter 3, a continuation of Chapter 2, studies the robust formation con- 
trol problem for a team of quadrotors with communication delays. A dis- 
tributed formation controller is designed for the quadrotor team. It’s further 
proven that the tracking errors can converge into a neighborhood of the ori- 
gin bounded by a given constant in a finite time. Experimental results on 
multiple quadrotors are provided to verify the effectiveness of the proposed 
control method. 

Chapter 4 focuses on the formation control for a team of quadrotors subject 
to switching topologies. A robust control approach is proposed that consists 
of a position and an attitude controller. Theoretical foundations, detailed 
simulation studies, and experimental results validate the effectiveness of the 
proposed methodology. 
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Chapter 5 considers the time-varying formation control problem or a 
group of tail sitters in flight mode transitions between forward and vertical 
flight. A robust distributed formation control method is proposed to achieve 
the aggressive time-varying formation subject to nonlinear dynamics and 
uncertainties. The robustness issue of the robust protocols is also discussed. 
Simulation results for a team of tail sitters to achieve the time-varying forma- 
tion in flight mode transitions are provided to show the effectiveness of the 
proposed control strategy. 

Chapter 6 studies the fault-tolerant time-varying formation control 
problem for a group of tail sitters with multiple actuator faults and uncertain- 
ties. A robust distributed fault-tolerant formation control strategy is devel- 
oped. The information of the actuator faults does not need to be identified 
online and the tracking errors of the global closed-loop control system can 
converge into a given neighborhood of the origin in a finite time. Simulation 
results are also presented to show the effectiveness of the proposed control 
strategy. 


2 


Robust Formation Control 
for Multiple Quadrotors with 
Nonlinearities and Disturbances 


Formation control for a group of unmanned aerial vehicles (UAVs) is chal- 
lenging due to the complex systems dynamics in the cooperative feedback 
loops. This chapter investigates the problem of the robust formation control 
for a group of quadrotors with underactuation, high nonlinearities and cou- 
plings, and disturbances. A distributed robust controller is developed, which 
consists of a position controller to govern the translational motion for the 
desired formation and an attitude controller to control the rotational motion 
of each quadrotor. Both rigorous theoretical analysis and simulation results 
are presented to validate the effectiveness of this method. 


2.1 Introduction 


Formation control of multiple autonomous UAVs has received much recent 
attention because of potentially broad applications in engineering and sci- 
ence, such as robotics, aerospace, and wireless communication, as illustrated 
in [36-39]. Multiple UAVs can be used to carry out tasks in dangerous situa- 
tions, for example, reconnaissancing over hostile territories or tracking battle 
damage of enemy targets (see, e.g., [36-39]). UAVs have many potential mili- 
tary and civil applications and are also of great scientific significance in aca- 
demic research (see [40, 41] and the references therein). With the increasing 
demand of multi-UAV systems to cooperate and complete complex tasks, it 
is important to realize flight formation in a robust manner for these multi- 
agent systems. 

Motivated by the wide range of possible military and civilian applications, 
formation control of UAVs has attracted a considerable amount of research 
interest in the past decade. According to different criteria, formation con- 
trol approaches in the existing literature have different classifications. In the 
last two decades, several classical methodologies have been developed to 
address the formation control of multi-agent systems, including the behav- 
ioral strategy, the virtual structure method, and the leader-follower approach 
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(see, e.g., [2, 14-16, 19, 42-45]). Each of the above three approaches has disad- 
vantages [46]. For example, it is hard for the behavioral strategy to explicitly 
define the group behavior or mathematically analyze the stability properties 
of the global formation system. The virtual structure-based strategy requires 
the formation to act as a virtual structure and limits the potential applica- 
tion scales of this approach. Furthermore, there is no explicit feedback from 
the followers to the leaders, and the leader-follower method loses robustness 
upon the failure of the leader. 

Recently, consensus problems of linear time-invariant swarm systems 
or multi-agent systems have been studied extensively. The leader-follower, 
behavioral, and virtual structure-based formation control methods can all 
be unified in this general framework [19]. Many results that utilize the con- 
sensus protocols for the UAV formation control have been derived in, e.g., 
[11, 21-24]. Quadrotors serve as efficient aerial platforms and possess many 
features such as the capabilities to hover and take off and land vertically 
and have simple mechanisms without swashplates or linkages, as depicted 
in [48, 49]. 

In recent years, many studies on formation control of UAVs have been car- 
ried out in both aeronautics and robotics communities. In [11, 26, 39, 43, 44], 
each vehicle system was simplified as a first-order or second-order linear sys- 
tem and the rotational dynamics was ignored in the stability analysis of the 
multi-agent systems. In [19, 22, 23, 38], the formation control problems were 
addressed for multiple nonlinear systems. In [2, 14, 15, 45], the cooperative 
tracking problems were discussed for a group of quadrotors with transla- 
tional and rotational motions, but the complex nonlinear vehicle dynamics 
was simplified or linearized. In practical applications, the quadrotor is a 
multiple-input multiple-output underactuated system involving highly non- 
linear and strongly coupled dynamics. The nonlinear models of complex 
dynamics and 6-degrees-of-freedom (6-DOF) were also considered in the 
flight formation control of multiple quadrotors. In [16], a robust formation 
control method based on leader-follower structure was proposed for quadro- 
tors with nonlinear dynamics. In [21, 44], the consensus-based formation con- 
trol strategies were constructed for multiple nonlinear quadrotor systems. 
However, the disturbance rejection problems were ignored in many previ- 
ously published studies on the design of flight formation controllers. In for- 
mation flight, environmental uncertainties such as atmospheric disturbances 
act as additional forces and moments on the quadrotor dynamics, which can 
seriously affect the stability of the quadrotor formation system. 

In [22, 23], a robust distributed formation controller was designed for a 
class of 3DOF helicopters to achieve desired formation flying under exter- 
nal disturbances. In [25], an adaptive consensus control method was devel- 
oped for multiple nonlinear agent systems. However, the underacturated 
and uncertain 6DOF system dynamics were not further considered. In [16], a 
suboptimal control controller was designed for the classical leader-follower 
formation control problem of uncertain quadrotors; however, the stability for 
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the overall underacturated multi-UAV systems was not fully analyzed and 
the control method cannot reject the disturbances in the whole frequency 
range as much as desired. 

Motivated by the above factors, the formation control for multiple quadro- 
tor swarm systems subject to disturbances and underactuated, highly nonlin- 
ear, and strongly coupled agent dynamics is studied in this chapter. A robust 
control approach is developed to address the formation control problem for 
a group of quadrotors with nonlinearities and uncertainties. The proposed 
overall controller consists of a position controller to govern the translational 
dynamics to achieve the desired formation trajectory and pattern and an atti- 
tude controller design to stabilize the inner rotational dynamics. Compared 
to previous studies on quadrotor formation control, the main contribution of 
this chapter is threefold, which is summarized as follows. 

First, each quadrotor considered here is underactuated. However, the 
formation control problems for such underactuated systems were not fully 
studied in [11, 22, 23, 26, 38, 39, 43-45]. Second, the external disturbances are 
considered in both the translational and rotational dynamics of the under- 
actuated model. In [36, 38, 41] and [2, 11, 15, 21, 27, 45, 48], the disturbance 
restraining problem was ignored, while the stability of the whole uncertain 
and nonlinear underactuated multi-UAV system was not fully analyzed in 
[15, 16, 22-25]. Third, highly nonlinear and strongly coupled dynamics are 
considered, and the formation control problem under aggressive maneu- 
vers is addressed for a group of quadrotors. In particular, the translational 
dynamics is bilinear, and the backstepping approach newly developed in [50] 
is used to obtain an inverse kinematrics solution of the quadrotor model. 
However, the formation control problem is not limited to the hovering or low- 
speed scenarios that are constrained by the simplified or linearized vehicle 
model, as adopted in [2, 15, 45]. In addition, the graph theory is introduced 
to address the consensus-based formation control problem and the resulting 
global flight control laws are distributed. 


2.2 Preliminaries and Problem Formulation 


In this section, basic concepts of the graph theory are introduced and the 
problem description is presented. 


2.2.1 Quadrotor Model 
Consider the dynamical model of quadrotor i as a rigid body. Let 
p=[Px Py p.] € R?" represent the position vectors in the earth-fixed iner- 


tial coordinate and O= E 0 v] € R”! indicate the three Euler angles, 
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ie, the roll, pitch, and yaw angles, respectively. The roll and pitch angles of 
the ith quadrotor are assumed to satisfy: |¢;| < z/2, 6; < z/2, and wi « x/2, 
respectively, to avoid the singularity problem in the Euler angle expressions. 
From [51], the full dynamics of a quadrotor can be modeled as 


mj = Rf, 
Jo = c(6,0)0 « v, (2.1) 
where m denotes the quadrotor mass and J = diag(], Jo, Jy} e R^? denotes 


the inertia matrix. Denote R e SO(3) as the rotation matrix, which can be 
described as 


cos0cosy cosy sinó$sinO —cosósiny singsiny + cos cosy sind 
R=| cos0siny cosgcosy +singsin0siny — cosósinOsiny — cosy sin 
—sin@ cos 0sin ó cos $cos0 


As depicted in [51], the Coriolis term C(O, 0)= [ci] € R?? can be described as 
follows: 


Cu 7 0, 
cn = (Jo — Jy (0 cosósin ó + V sin? 9 cos0) + (Jy — Jo cos? pcos0 — y cos0, 
C13 = (Jy — Jo cosó sin $ cos? 0, 
Cn = (Jy — Jo) (0 cosósin à sin? 6 cos0) + (Je — Jy )W cos? 6 cos0 + Jay cos8, 
Cy = (Jw — Jo )ó cosósin 6, 
C» = — Ja sin 0 cos 0 + Jyy cos? $ cosO sin 0 + Jay sin? $ cosO sin 6, 
c31 = (Jo — Jy cos? 0sinócosó — JA cos0, 
Cz = (Jy — JoY(0 cos sin $ sin 0 + ósin? $cos0) — Jay sin? gsin 0cos 
+ (Jo — ]y)ó cos? cos 0 + JA sin 0 cos0 — JW cos? 6 cossin 0, 
c33 = (Jo — Jy cos ósin cos? 6+ J,sin 0cos0 — JO sin? $ cos Osin 0 
— IM cos? ósin 0 cos 0. 


The external force f of the quadrotor can be calculated by 


f=[0 0 &[-mw[o 0 mg], (2.2) 
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where g represents the gravity constant. The total lift fr and the torque 


[E 
T= E To Ty | can be expressed as 


4 
fr =k, i, 
j=1 


t, = lek (03 — 01), 
(2.3) 
To = Ik (o1 — 03), 


4 
Ty = kX Do}, 
j=1 


where ks, le, k, are positive parameters and o; (j = 1,2,3,4) are the rotational 
speeds of Rotor j. The control input commands to the four rotors can be writ- 
ten as follows: 


(2.4) 


Remark 2.1 


It should be pointed out that quadrotor i is an underactuated system, which 
possesses 6-DOF (the height, the lateral and longitudinal positions, and three 
attitude angles) and four inputs (uzi, uoi;, 44o2;, He3,;). In this chapter, the 
position and heading control mode is chosen for each quadrotor, including 
the longitudinal position px, the lateral position p,, the height p., and the yaw 
angle y as outputs and ue, uy, uz, and uy, as control inputs. 


Remark 2.2 


It can be observed that the vehicle system is highly nonlinear and 
strongly coupled, especially considering the expressions of the Coriolis 
term C(0,0). 
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2.2.2 Preliminaries on Graph Theory 


Consider a group of N quadrotors labeled from 1 to N. Let ®= {1,2,...,N}. 
Let directed graph G =(V,E,W) represents the information exchange among 
the N quadrotors. V = {0),02,...,Un } denotes the set of nodes, where v; denotes 
the ith quadrotor. E c l(vi,vj): 01,0; EV, 1# j} denotes the set of edges, and 
£j = (viv i) e E indicates that the ith quadrotor can receive information from 


its neighbor, the jth quadrotor. Let N; = { ilo, vj)eE } denote the set of neigh- 


RIN 


bors of a node v;. W = [ wi | e is the weighted adjacency matrix associ- 


ated with G. For any i, j e 6, wj > Oif and only if g; e E, and wj; = 0 otherwise. 
A simple graph is considered here and thereby w;; = 0. For the node v;, the 


N 
weighted in-degree d; is defined as the ith row sum of W as d; = b» Wi 
i 


Define the in-degree matrix as D = diag{d;} and the weighted graph Laplacian 
matrix as L = D — W. A directed path from v; to v; is termed as a sequence of 
ordered edges in the form Erin (k = 1,2,...,7— 1). The graph G is said to con- 
tain a spanning tree if there exists a root node having directed paths to all 
other nodes, and the node is called the root. 


2.2.3 Problem Formulation 


The main goal of this chapter is to design a distributed robust control- 
ler for the group of quadrotors to achieve the desired formation trajectory 
while keeping the desired formation pattern. The prescribed reference 
trajectory of the formation center is denoted as p,; € R^", which can also 
be viewed as the trajectory of a virtual group leader. The reference p,o is 
assumed to be differentiable and its second derivative f, = 0. Let ô; = 0; —ó;, 
where 6; or 6; can represent the desired position deviations between the 
formation center p, and the ith quadrotor or the jth quadrotor, respec- 
tively. In this chapter, the time-invariant formation pattern is considered for 
the group of quadrotors, and thereby 6; is a constant. Define the desired 
position deviation between the ith quadrotor and the jth quadrotor as 


ôy =|; Sy, &4] e R?" (i, j e 4). 6; determines the formation pattern 
of the quadrotor group. 


Then, for the ith quadrotor, the translational and rotational model can be 
rewritten as follows: 
Pi = UziBp:RiC3,3 — gC55, 
M "m (2.5) 
0; = J'C@;,0,)®; + Bejttei, 
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respectively, where Ue = [uoi Ugi Uyi iv Be; = Ji diag {lik plik pi, Kai), 
Bpi = mik ls, and c3, = [0 0 1f. For the ith quadrotor, one can obtain the 
following model by introducing disturbances: 


pi = By iF; — 86353 + BF; Ez dy, 


. MN (2.6) 
0; = J7'C;(O;,0;)O; + Boite; + doi, 


where F,=u.;Ric33-—F; and the atmospheric disturbances d, € R^" and 
do; € R?! are additional forces and moments and are assumed to be bounded. 
The variable F; = [ Fi: | € R*' is the virtual position control input to be deter- 


mined and satisfies 


sin ¢; sin y; + cosó; cosy; sin ,; 
F;=u,| cosó;sinO;siny;—cosy;sinQ,; |, (2.7) 
cos d; cos 0; 


where 6,; and @,; are the references for the pitch and roll angles, respectively. 
The yaw angle is required to track the reference v ,;. 


Remark 2.3 


Because each quadrotor system is underactuated, the quadrotor dynamics is 
decomposed into the attitude dynamics and the position dynamics as given 
in the first and second equations in (2.6) for the backstepping-based control- 
ler design. Then, by considering F; (i e ®) as the virtual position control input, 
the attitude and position controllers can be designed, respectively, based on 
the backstepping approach [50]. 


Define the uncertainties A,;, Ag; as 
Ay =B iF; t+ dpi, 
p p p (2.8) 
Ag; = doi, ie %. 


Here, Api=| Ap, | e R”! and Ag; [^o;;] € R?" are the equivalent disturbances 
involving the force error E. The nonlinear model (2.6) can then be rewritten as 


pi = BpiFi — 8055 + Api, 
. u Q.9) 
O; = Ji'C(©;,9;)0; + Bele: + Aoi, ie. 


24 Robust Formation Control for Multiple Unmanned Aerial Vehicles 


Remark 2.4 


One can see that the translational dynamics is bilinear due to the first term 
on the right-hand side, i.e., F; (i e ®) from the first equation in (2.6). In fact, 
the dynamics of each quadrotor cannot simply be separated into the trans- 
lational dynamics and the rotational dynamics, due to the existence of the 
coupled term Å in the first equation of (2.6). Actually, the force error £, is 
included in the equivalent disturbance A,;. 


Remark 2.5 


The model (29) represents the real dynamical model of each quadrotor. One 
can obtain the nominal model by removing the equivalent disturbances Ay; 
and Ae;. The complete model includes the nominal model and equivalent 
disturbances. 


2.3 Formation Protocol Design and System Analysis 


In this section, the formation controller is designed based on the robust 
compensation theory, followed by the analysis of the tracking performance 
and the robustness property of the whole cooperative system. The designed 
controller consists of a position controller to govern the translational motion 
for the desired formation and an attitude controller to control the rotational 
motion of each quadrotor. 


2.3.1 Position Controller Design 


The virtual position control input F; consists of two parts: 
F.=FY+FS,ie®, (2.10) 


where E" e R*' denotes the nominal part and F? e R^" denotes the robust 
compensating part. 

The nominal control input F e R?" is designed to achieve the desired forma- 
tion control for the nominal translational system, while the robust compensating 
input E^ e R?" is designed to restrain the effects of A,; on the whole closed-loop 
system. The nominal part E^ (i e ®) is constructed by ignoring A,; as follows: 


EN = -o You Bt (Ky (p.—p)~6)) K (9s) 


jeNi 


= OpbiBoi (K, (pi a 6; aa Pro) + K, (bi m P«o)) + gBrils,3, (2.11) 


Robust Formation Control for Multiple Quadrotors 25 


where @, represents a positive coupling gain and K,,K, € R^? are nomi- 
nal controller parameter matrices with positive elements. The constant bj 
indicates the connection weight between the virtual group leader and ith 
quadrotor: b; > 0 represents that the ith quadrotor can obtain the information 
from the virtual leader, and b; = 0 otherwise. 

Furthermore, E^ (ie ®) is introduced to restrain the effects of A; on the 
real system. The robust compensating input is designed as follows: 


EF - T (s)EF = -BjT (s)A,;. (2.12) 


whereT ,;(s) = diag {T (s), T’,2,:(s), T’,3,i(s)} andT,, :(s) = 1;;/(s + pi) G = 1, 2; 3) 
with rjj; (J = 1,2,3) are positive robust filter parameters. 


Remark 2.6 


One can see that the robust filter D; ;(s) has the following property. A larger 
Tpj,i leads to a wider frequency bandwidth of I; \(s), within which the filter 
gain is closer to 1. In this case, one can see that the robust compensating 
input is approximate to E" = —B;; A „; the effects of A; on the real system can 
be counteracted completely. 


pir 


Remark 2.7 


It should be noted that the equivalent disturbance A,; (i e ®) does not rep- 
resent a real external signal but includes the system state variables, which 
poses a challenge in the analysis of the tracking performances and robust- 
ness properties for the overall system. 

The robust compensating input (2.12) cannot be implemented in practical 
applications because A,; cannot be measured directly. From (2.9), one has that 


Api = pi — By iF; F 803,37 ied. (2.13) 


Let rj; = diag (pii pasi psi }- Substituting (2.13) into (2.12), one can obtain 
that as 


à, = Np; z nipi + ByF; — 863,3, 
BY; = —Npid$; + 2N pipi + Of, (2.14) 
fe Bin; (07; -pi), ied. 


Furthermore, by solving the equation in (2.7), one can obtain the vertical con- 
trol input u,; and the pitch and roll angle references 6,; and $,; as follows: 
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uzi = F3;/ cos6;/cos6;, 
6, = sin (Fiu; /uzi — sing; sin y;)/cos¢,/cosy;)), (2.15) 


i = sin” ((cos@; sin 8; siny; — P;/uz;)/ cosy). 


2.3.2 Attitude Controller Design 


The attitude controller is designed to achieve the desired attitude ref- 
erence tracking. Let 0, -[8;; Qi va] be the attitude reference and 


eoi = [e eg; evi | =0;-©,; (i e o) be the attitude error. Similarly to the 
virtual position control input F;, the attitude control input ue; is constructed 
as follows: 


Uoi = UÑ +u; ie, (2.16) 


where uj; denotes the nominal control part and ug; denotes the robust com- 
pensating part. The nominal attitude control input ug; can be designed as 


ug; = Bal (-Keee; = Ko€oi = Ine (:» 0;)0; + Ön). (2.17) 
The robust attitude compensating input ug; is designed as 
Ug; = —BaiT oi(s)Aci, (2.18) 


where Ke,K, eR?? are diagonal nominal controller parameter matri- 
ces with positive elements and  De(s)- diag(Ue:;(s),Uoz;(s),Uos;(s)), 
and Te;;(s)=nâ;; /(5+1e;)” are robust filters with positive parameters 
Naji (= 1,2,3) to be determined. Let Nei=diag {No1,i,Ne2,:,Nes, ]- Similarly, 
from (2.9) and (2.18), u$; can be realized with filter states 07,09 € R^"! as 
follows: 


ÒR = -Navi — rio; + Beitte: + J; C((8;,0;)O;, 
oe = -Nov +2190; + oT, (2.19) 


uk; = Ban (Vg —0;), i e ®. 


Remark 2.8 


One can see that the proposed robust formation controller is distributed and 
time invariant, which means that the controller of quadrotor i only depends 
on the position and velocity information from itself and its neighbors. 
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2.3.3 System Analysis 


Define the position error as ey; = p; — Ôi — pro = [evi | € R^" (ie). Combining 
(2.9)- 2.11), one can obtain that 


pi = -0,9 w; (K, (epi = ej) + K, (dy 5 &y)) 


jeNi (2.20) 


= a,b; (K,ey; + Kobi) + BF + Api- 


Letz,-[eh él] andzoi=[ed, éb; |. From (2.9), (2.16), (2.17), and (2.20), the 
closed-loop node error system can be written as 


dy = Ayzy - 0B. V wy (Kp (epi — 6j) + Ko (îi ui) 


jeNi 
= otb;B. (Kepi + Koby: ) + B. (BEP + Api)» (2.21) 
Zei = AeZei + B; (Boiu; + Aci), ie, 


where 


03x I 05. I Ca 
Ay = M x „Ae = 3x3 3 ,B,- 3x3 I 

0x3 Osa -Ko -Ko L 
Then, the global error dynamics of the whole quadrotor group can be given 
by 

£, = (Iu @ A, - e, (L-- B.) 8 B.K.)z, * (In 8 Bz) A, 
_ EN (2.22) 
= ApeZp + Bay, 

and 


Ze = (In ® Ag)Zze + (In & B.)Àe = Aezo + Bado, (2.23) 


where  z,= [zp] eR'* ze=[zeleR°™, A,= [ BFF + ^y | en 


Ag = | Bois +F Aai | € Rose BL = diag {b; } € R^. and K, = [K, K, I 


Lemma 2.1 


Let the design matrices Q, = Q} € R® and II, =, e R^? be symmetric and 
positive definite. Let the design matrices Ko, Koe be diagonal matrices with 
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positive elements. Design the nominal position controller parameter matrix 
K,as 


K =1,'B!P,, 


where P, is the unique positive definite solution of the following associated 
Riccati equation 


ATP, +P, Ay +Q, — D,B.IT; BI P, = 0. 


It can be seen that all the eigenvalues of Ao. have negative real parts, and 
thereby Ae: is asymptotically stable. If the root can receive the information 
from the virtual leader and the graph G has a spanning tree, then o, 2 0.545", 
where 45," = min;zs Re(A,;) and A»; indicates the eigenvalues of (L+ B.) and Ay. 
is asymptotically stable. 

Proof According to Theorem 1 in [52], A, is asymptotically stable. In addi- 
tion, if Ke and K, are diagonal matrices with positive elements, Ae. is also 
asymptotically stable. 


Theorem 2.1 


Consider the dynamical model of the quadrotor as depicted in (2.6), the robust 
formation controller consisting of (2.10), (2.11), (2.14), (2.15), (2.16), (2.17), and 
(2.19), and the nominal controller parameters determined by Lemma 2.1. If 
the graph G has a spanning tree, the root can obtain the information from the 
virtual leader, and the initial states z,(0) and ze(0) are bounded, then for any 
given positive constant e,, there exist finite positive constants T`, n}, no, such 
that for any 1; 2 N; and ne; 2 Ne (ie ®), then one can obtain that all states 
involved are bounded and the position error e,; and the yaw error ey; of each 
quadrotor satisfy that max; ley; (t) < e, and eyi(t)| < £e, VE 2 T^, respectively. 
Proof 2.1 Combining (2.12), (2.16), (2.22), and (2.23) yields that 


Zp = Aou * B. (lax a T,(s))Ap, 


Ze = AecZo + Ba (In E l'e(s))^e, 


where L,(s)- diag(T,(s)) e R?"?", To(s)= diag(Fo(s)) eR?"?V, A =A] 
e R?"* and Ae = [Ae;] e R?"*. It follows that 


zs]. S72, + Xap |A; 


7 
Joo 


(2.24) 
\Zel|,, S T220) + Hse ||Aoll,, > 
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and 


max 
j 


2,0) < max chy e^ 2,0] + x [A 


i (2.25) 
max 2o() < max cix, je**"zo(0) + Xe [^e]... 


where 


chy e^" z, (0) 


7Uz, (0) = max; SUpi:so 


7 


T Act 
7 z9(0) = max; SUP 0 |C6N, je * Zo (0) 


7 


XBp = Sax = Ap) | Ba(Isn zi r’,(s)) 


4 
Mee = (lex — Ae) Ba (Isw — To(5))), i 


From Remark 2.6, one can have that the gains of the robust filters I; (s) and 
T'e;,;(s) are closer to 1 by selecting positive parameters n,;; and re; ; (i e ®). In 
this case, ys, and yse can be made as small as desired by selecting r],;; and 
Noj, properly. Since Ag in (2.8) is norm bounded, one can have that positive 
constants £, and £4e exist such that 


lAoll, S £e zel. + £ae- (2.26) 


If the robust filter parameters rjj; (i e ®) are selected such that ye < ex, one 
can yield the following inequality by substituting (2.26) into the second equa- 
tion of (2.24) as 


Tz9(0) A Be€4o 


Zo| S 
zel. 1- Xze£:e 


(2.27) 


For the bounded initial state ze(0), one can see from (2.27) that ze is bounded, 
and thereby Ae is bounded. Besides, one can obtain that the states of the 
robust compensating input ud; and the composite control input ue; are 
bounded. Now, it can be obtained that all states involved in the rotational 
dynamics are bounded. 

Furthermore, there exist positive constants £3, and £455; such that 


Lv 


bo S Eep3,i 


Zp3,i » + € Ap3,i; ie o, (2.28) 


s up . . : 
where zp3,; = [65; pai | . Similar to the derivations of the rotational dynam- 
ics as shown in (2.27), one can obtain that all states in the vertical dynamics of 
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the global system are bounded. Therefore, it follows that the vertical control 
input 1; is bounded, and thereby F; is bounded. From (2.8), one can obtain 
positive constants £4,,; and £4p2,; such that 


Avni 


NS 


IA, 


L S £a, 1E o. 
Therefore, there exists a positive constant £a such that 
la, S £x- (2.29) 
From (2.24) and (2.29), one can have that 
ls ||. < 72,0 + Xsp£ap- (2.30) 


One can see that for the bounded initial state z,(0), z, is also bounded. In 
addition, one can obtain that the states of the robust compensating input 
FE (ie 0) and the composite control input F; are bounded. It follows that all 
states involved in the translational dynamics are bounded. 

Now, from (2.25), (2.26), and (2.29), one can have that 


max zy (f) < max cy e^ 2,0), + XBpE Mp, 
i (2.31) 
max zej(f) < max ex je ^9 zo (0) + Yse£20- 
j j 


Since A, and Ae, are asymptotically stable as shown in Lemma 5.1, there exist 
positive constants T'„n,,ne, such that for any n; 2 uU and Noj 2 No (ie), 


then one has that max; ey, (t) € e, and eyi(t) <E, VE2T O 


Remark 2.9 


It should be noted that the robust compensator parameters nj; and 
Naji (i € ®) determined by Theorem 2.1 are conservative, which means that 
the theoretical value of rj; and rej; (ie b) may be much larger than its 
real one. Therefore, in practical applications, one can determine the robust 
compensator parameters using an online tuning method: first, set nj; and 
Naji (i€ ®) with initial small values; second, increase nj and rej; (i e b) 
until the desired tracking performance of the proposed closed-loop control 
system is obtained. 
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Remark 2.10 


If the second derivative of the attitude reference, e.g., 6, (ie 0), cannot be 
obtained directly in practical applications, it can be ignored in the nominal 
attitude control law, as shown in (2.13). In this case, 6, can be considered as 
disturbances and included in the equivalent disturbance Ag;. The robustness 
properties of the global swarm system can still be guaranteed. 


SS -—————————————— ————— 


2.4 Numerical Simulation Results 


In order to validate the proposed control algorithms presented in this 
chapter, the control strategy is implemented on a team of three quadro- 
tors, whose dynamics is subject to underactuation, nonlinearities, 
and disturbances. The quadrotor parameter matrices are selected as 
Be; = diag{9.2,9.7,15.99} and B, =diag{1,1,1}, m; 22 kg, g; =9.81 m/s?, and 
Ji = diag{0.109, 0.103, 0.0625] kg. m?. The positions of the three quadrotors are 
required to maintain a constant formation pattern, described by a triangle 
to the horizontal plane in the inertial coordinate as follows: ó; = [1 1 o], 
6» = [-1 1 oF, and 63 = [-1 -1 oF, while the yaw angle of each vehicle is 
required to be stabilized at 0 deg. The controller parameters in the numerical 
simulations are selected as follows: Ke = diag{50,50,50}, Ko = diag{35,35,35}, 
K, = diag(0.7,0.7,0.7), K, = diag{1,1,1}, @, = 5, neji = 20, and n,j,; = 1. Sete. = 0.1, 
and a simulation test is conducted to check whether the tracking errors 
converge into the neighborhood of the origin bounded by £, in a finite 
time, as shown in Theorem 2.1. The formation mission is implemented 
by the group of quadrotors with bounded initial states. The initial con- 
ditions of the four quadrotors are selected as p;(0)- [15 15 - 1f, 
p(0)=[-1 2 -1]',p3(0)=[-1 -2 -1f ġ(0=[-0.1 0.1 0.1f,p2(0)= 
[0.2 -0.1 -0.1]', p3(0)=[0.1 -0.2 01],00)-054, and È;(0)= 05. 

In the simulation, there are five vehicles and the communication topology of 
vehicles is described in Figure 2.1. The set of edges E = { (v3, v1), (V3, v2), (v4, v1) 
and the weighted adjacency matrix W=[|w;] with w; = 0.5 for (v;,vj)) eE 
and 0 otherwise. The root vı can obtain the information from the virtual 
leader, and b; = 0.5 for i=1 and 0 otherwise. The reference trajectory of the 
virtual leader is described by p,o(t)=[0.4t 0.4t 0.8] . The ith quadrotor 
dynamics is subject to the nonvanishing and time-varying external atmo- 
spheric forces and torques as (-1)'[0.1cos() 0.1sin(t) 0.1cos(t) | and 


(-1)'[sin(t) cos(t) sin(?)] , respectively. 
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FIGURE 2.1 
Desired formation pattern and communication graph. 


The three-dimensional (3-D) trajectories of the three quadrotors are 
depicted in Figure 2.2. The longitudinal, lateral, and vertical positions are 
depicted in Figure 2.3. The translational velocities, the Euler angles, and the 
position errors are given in Figures 2.4, 2.5, and 2.6, respectively. The dashed 
lines represent the formation patterns. From these figures, it can be observed 
that the position tracking errors can converge into the neighborhood of the 
origin bounded. The proposed global closed-loop control system can achieve 
good tracking performances and robustness stability properties. The effects 
of nonlinear dynamics, parametric perturbations, and external disturbances 
can be restrained by the proposed formation protocol. 
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FIGURE 2.2 
Three-dimensional trajectories of three quadrotors. 
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FIGURE 2.3 
Position responses of three quadrotors. 
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FIGURE 2.4 
Translational velocity responses of three quadrotors. 
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Euler angle responses of three quadrotors. 


36 Robust Formation Control for Multiple Unmanned Aerial Vehicles 


Longitudinal error (m) 
eo 
| 


0 2 4 6 8 10 12 14 16 18 20 
Time (s) 
(a) Longitudinal error 
T T T T T T T T T 
E 2} 
5 
© oF 
E: 
p 
S2 
1 L L 1 1 L 1 1 L 
0 2 4 6 8 10 12 14 16 18 20 
Time (s) 
(b) Lateral error 
T T T T T T T T T 
E zr 
5 
9 ZA 
E 
iS 
5 
= er 
1 1 1 L L 1 4 L 1 
0 2 4 6 8 10 12 14 16 18 20 
Time (s) 


(c) Vertical error 


FIGURE 2.6 
Position errors of three quadrotors. 


2.5 Conclusion 


The formation control problem of a team of quadrotors with underactu- 
ated, highly nonlinear and strongly coupled dynamics, and disturbances 
is addressed in this chapter. A distributed controller is proposed based on 
the robust compensation theory and the backstepping approach. The pro- 
posed robust formation controller includes a position controller to achieve 
the desired formation trajectories and patterns and an attitude controller to 
regulate the attitudes of quadrotors. The robustness properties of the global 
closed-loop control system are proven. Numerical simulation studies are pro- 
vided to show the effectiveness and the advantages of the proposed robust 
formation protocol. 


3 


Robust Formation Trajectory Tracking 
Control for Multiple Quadrotors 
with Communication Delays 


Communication delays are inherently present in information exchange 
between quadrotors and have an effect on the control performance of 
quadrotor formation. This chapter investigates the robust formation control 
problem for a team of quadrotors with communication delays. The dynamics 
of each quadrotor is subject to nonlinearities, parametric perturbations, and 
external disturbances. A distributed formation controller is developed for 
the quadrotor team to overcome the unknown delays. The designed control- 
ler consists of a position controller to achieve the desired formation trajecto- 
ries and patterns and an attitude controller to regulate the attitude angles for 
each quadrotor. The robustness of the constructed global closed-loop control 
system can be proven by the Lyapunov theorem. Experimental results on 
multiple micro quadrotors are provided to verify the effectiveness of the pro- 
posed control method. 


3.1 Introduction 


In recent years, formation flight control has been extensively studied in the 
literatures for a broad range of applications in various areas, such as com- 
munication relay, search and rescue, and persistent reconnaissance, as illus- 
trated in [54-57]. Multiple unmanned vehicles (UAVs) cooperate with each 
other to solve some tasks which are difficult for the traditional single aircraft. 
Over the past two decades, several classical formation control methods have 
been developed to achieve formation control for multi-agent systems, such as 
the leader-follower method, the behavioral strategy, and the virtual structure 
approach (see, e.g., [14, 16, 19, 26, 38, 44]). However, leader-follower, behavior, 
and virtual-structure-based formation control approaches have their own 
strengths and weaknesses. Recently, a consensus-based approach has been 
developed, which serves as a promising solution to address the formation 
control problem of a team of UAVs, as shown in [11, 21, 22, 23, 27, 28, 60, 61]. 
For example, leader-follower approaches are easy to implement but have no 
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explicit feedback on the formation and lack of robustness due to the existence 
of the leader, behavior approaches can ensure collision avoidance but are dif- 
ficult to analyze mathematically, and so on. 

Quadrotor UAVs served as popular aerial platforms possessing various 
advantages such as low-cost, simple structure, vertical take-off and landing, 
as illustrated in [51, 59]. In prior works, several typical approaches are pro- 
vided for a team of UAVs to achieve formation flight missions with free time 
delay. In [38], an integrated optimal control framework was developed for 
fixed-wing UAVs to achieve formation trajectory tracking. In [19], a poten- 
tial field-theory-based control scheme was proposed to achieve formation 
flight. In [55, 57], the formation control for a set of UAVs was addressed. In 
[44], a hybrid three-dimensional formation control framework was presented 
under the leader-follower context using UAVs with simplified translational 
dynamics. In [11], the dynamical model of each vehicle was considered as 
a second-order linear system and the formation experiments were imple- 
mented. In [19] and [38], the formation control problem for multiple nonlin- 
ear vehicles was discussed. However, the vehicle dynamics was simplified 
and the formation control problems for such underactuated systems were not 
fully studied in [11, 44, 55, 57]. 

Furthermore, the formation control problems for a team of uncertain sys- 
tems were studied in [16, 22, 23, 25]. In [16], the formation control problem for 
a team of uncertain quadrotors was discussed based on the classical leader- 
follower method, and a H. control controller was developed to restrain the 
effects of model uncertainties and external disturbances. In [22] and [23], a 
disturbance estimator was constructed for multiple 3-degrees-of-freedom 
(3-DOF) helicopters in the presence of model uncertainties and external dis- 
turbances in the rotational dynamics, but the underactuated 6-DOF aerial 
vehicle system was not further discussed. In [25], a robust formation con- 
trol strategy was proposed for a team of nonlinear systems with parametric 
perturbations. 

Noteworthy, time delays in the existing communication mechanism are 
inevitable in practical applications. It is worthwhile to point out that the 
above-mentioned results with a straight application to the case with com- 
munication delay will deteriorate the control performance. Moreover, several 
works have been conducted to address the robust formation control problem 
for a team of UAVs subject to communication delays. 

In [26], a model predictive formation control method was proposed to 
achieve the formation flight control for multiple quadrotors with communi- 
cation delays. In [27], a sufficient condition was proposed for the consensus 
of discrete-time multi-agent systems composed of double-order dynamics 
with bounded communication delays. In [28], a formation control method 
was developed for the second-order agents to achieve the desired formation 
trajectory tracking, and a neighbor-based feedback control rule was designed 
to reduce the effects of communication delays between agents. However, the 
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effects of other uncertainties were not fully discussed in the stability prop- 
erty analysis of the constructed closed-loop control systems in [26-28]. 

In this chapter, one focuses on solving the formation flight problem of 
UAVs in the presence of communication delay. A robust formation controller 
is proposed for a team of micro quadrotors subject to communication delays. 
The proposed formation controller consists of a position controller to achieve 
the desired formation trajectories and patterns and an attitude controller to 
regulate the attitude dynamics of the quadrotors. Both position controller 
and the attitude controller are developed based on the linear quadratic regu- 
lator (LQR) control method and the robust compensation theory. 

Compared to existing literatures, the main contributions of this chapter can 
be summarized as follows: First, the model of each quadrotor is an underactu- 
ated nonlinear system involving three translational DOF and three rotational DOF 
and the distributed indoor flight experiments for multiple micro quadrotors 
swarm systems to achieve time-varying formation are presented to demon- 
strate the advantages of the proposed formation control protocol. However, 
the formation control problems for such underactuated 6-DOF systems with 
completely nonlinear and coupled terms were not further discussed in [11, 
19, 22, 23, 44, 58]. Second, the influence of the parametric perturbations and 
external disturbances are considered in the dynamical model. However, in [11, 
21, 27, 28, 44, 47], the uncertainty rejection problems were not fully consid- 
ered in the robust stability analysis of the constructed closed-loop control 
systems. Third, the influence of the communication delays can be restrained 
by the proposed robust formation control protocol, and the tracking errors 
can converge into a neighborhood of the origin bounded by a given con- 
stant in a finite time. However, the effects of the communication delays on 
the global closed-loop control systems were not further studied in [14, 16, 19, 
21-24, 44, 47]. 


3.2 Preliminaries and Problem Formulation 
3.2.1 Quadrotor Model 


Consider N quadrotors modeled as rigid bodies. Let I denote the earth- 
fixed inertial frame and Ø the body-fixed frame attached to quadrotor 
i with the origin in its mass center. Define p; = | pai, Py pa] eR”! and 
v; = [ vxi, Uji, Uzi T e R?” as the position and the linear velocity of quadrotor i 


expressed in the inertial frame. 
As depicted in [51], the translational dynamics and rotational dynamics of 
quadrotor i can be written as 
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mip; = Roi foi + dpi, 
. - (3.1) 
JO; = Tpi + C;(0;, 0;)0; + dei, 


where m; and J; represent the mass and the inertia matrix of quadrotor i, 
respectively, C,(@;,0;) represents the Coriolis term as illustrated in [51], dj; 
and de; are the external disturbances, and 0; = di, 6;, vi] e R?* indicates 
the three Euler angles, i.e., the roll, pitch, and yaw angles, respectively. In 
order to avoid the singularity problem, the attitude of quadrotor i is assumed 
to satisfy: j| < 7/2, 6;| < 7/2, and |y;| « 2/2, successively. The rotation matrix 
Ry e SO(3) from the body-fixed coordinate to the earth-fixed inertial coordi- 
nate can be expressed as 


cos0; cosy; cosw;sing;sin 6; — cosó;siny; sinó;siny; + cos¢; cosy; sin 6; 
Ry; =| cosO;siny; cosó;cosy; + sinó;sinO;siny; cos@;sin 8; siny; — cosy; sing; 
—sin 6; cos 0; sin 4; cos@; cos 0; 


The external force fj; and torque Ty relative to the body-fixed coordinate of 
the quadrotor can be described as 


0 0 lyk;i(02.; i 0i) 
fi = 0 + Ri 0 „Toi = lyksi(01; E 05,) , 
T; Mig 


4 
ki (31)*!o?; 
r 


=1 


where g denotes the gravity constant, lyi, koi, and k;; are positive scale factors, 
and o, (r =1,2,3,4) denote the rotational velocity of rotor r. The total lift 


4 
T; = koi 1 o;; is assumed to be positive because o,,; is nonnegative and 
r=1 


T, — 0 results in a state of free for quadrotor i. The control input commands 
for quadrotor i can be denoted as follows: 


4 4 
» 2 2 2 = a2 2 _ X rH —2 
Uzi = Ori, lei; = 02; — Os, Woo; = Oii — O3,i, osi = A (1) Ori 
r-1 r=1 


Remark 3.1 


It should be noted that the quadrotor model consists of 6-DOFs (three trans- 
lational DOFs and three rotational DOFs) but four control inputs. Therefore, 
the quadrotor system is underactuated. In this chapter, the position and 
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heading control mode is chosen for each quadrotor, including the longitudi- 
nal position p,, the lateral position p,, the height p., and the yaw angle y as 
outputs, and ue, Us, uz, and uy as control inputs. 


3.2.2 Problem Formulation 


Define B,; = m; Ikg; and Bo; = Ji !diag (I ks;, ljksi, kri} (i € II). The parameters 
can be divided into two parts: the nominal part represented by the super- 
script N and the uncertain part represented by the superscript A, and, for 
instance, Be; = Bă + Bâ;. Let B» - diag (bj ,bpo, bps) and Bă = diag (bo, , bèz, b). 
Then, for quadrotor i, from (3.1), one can obtain that 
pi- Byiuyi — 8€5,3 + Api, 

(8.2) 
6; = Bote; T (J?)!C(6;,0,)0; + Agi, 


T P. z - 
where ue; iL Ue2,i1 uos, . Upi = [upi Upon pai | is the virtual position 
control input and satisfies 


sing; sin y; + cosg;cosy;sin6; 
Upi = uzi] cos&sin0;siny; —cosy;sinó; |. (3.3) 


cos; cos 0; 


Ay; and Ae; are named equivalent disturbances, which include the parametric 
perturbations and external disturbances, and can be given by 


Api = By ily + m; dy, 
-— ^" (3.4) 
Aa = -(J? ) 1 C(6;,0))6; + (Ji) ! C(6;,0;)Ó; + Bee; + ]; doi, 


where ip; is the force error and satisfies 
i; =| Tip, i], iili] uu (BN) BR 
Upi = | Upii, Up2,i, Up3,i = uzil pi) pilSbiC3,3 — Upi. 


The objective of this chapter is to design a distributed formation control pro- 
tocol for each quadrotor in the group such that the formation center of the 
quadrotors tracks a prescribed stationary trajectory and the quadrotors keep 
a geometrical configuration. 

Let p, € R^"! be the desired trajectory of the formation center, which can 
also be considered as the virtual team leader. p, is assumed to be differen- 


tiable, satisfying po = VO and po = 03x1: Define 6; = [ôni 62, i, 83 ij T € R*! 
(i,j € II) as the desired position deviation between quadrotor i and quadro- 
tor j, and ó; determines the formation pattern of the quadrotor team. 
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Let 6; =6;—6; (i, j eII), where 6; indicates the desired position deviation 
between the virtual team leader and quadrotor i. 
Let 6; represent the desired pitch angle and @; the roll angle ref- 
erences. The yaw angle needs to track the reference w;. Let 
T 
e; - [o Qe, Wi ] € R^". Then, one can obtain the position and atti- 
tude errors as ey = pi 6: — pr - [epi] eR*!, eri = epi = [en] E R°, 


T S T r 
Ce; = O; = O; = [eo] € R?” and Cai = Coi = [eox,i| € R? (i € II). 


Remark 3.2 


Model (3.2) represents the real vehicle model. By ignoring the equivalent dis- 
turbances A,; and Ag; (i e ®), the vehicle model (3.2) represents the nominal 
model. The real model can be considered as the nominal model added by the 
equivalent disturbances. 


3.3 Controller Design 


In this section, the formation protocol design problem for the group of 
quadrotors is investigated. The formation controller is designed based on the 
Linear Quadratic Regulation (LOR) approach and the robust compensation 
theory as illustrated in [62]. For each quadrotor, the proposed robust control- 
ler consists of a trajectory tracking controller to track the desired formation 
trajectory and form the desired geometrical configurations and an attitude 
controller to align the attitude angles in the rotational motion. 


3.3.1 Position Controller Design 


The virtual position control input u,;(t) consists of two parts: 
uy; (f) = un (t) + ust), i e TI, (3.5) 


where u} (t) e R^"! is the nominal control input to achieve the desired track- 
ing performance for the nominal translational system and uw5;(t) e R^"! the 
robust compensating input to restrain the influences of equivalent distur- 
bance on the real translational system. 

When quadrotor i receives the information (position and velocity) from 
its neighbor, i.e., quadrotor j, there exist communication delays in the infor- 
mation. Let p; represent the communication delays between quadrotor i 
and quadrotor j or the virtual team leader. The communication delays are 
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assumed to be nonnegative and piecewise continuous. The nominal control 
input up; can be designed as follows: 


ux (D = ur >, 0; (BA 5) K,(pi(t)- pilt- pu) mi + pilt)— pit- pr) 
jeNi 
-up $ (Bi) Ko (pi(Q)— p(t- p) 
dik ij By) j 8 


- use, (B3). K,(p.(t)- m pr(t- pi) 
— UrO i (BN) K, (pi(t) -p,(t- p) + g(BX)" C53, 


where u, is a positive scalar coupling parameter and K, e R?? and K, e R^? 
are the diagonal nominal controller gain matrices. The connection weight 
between the virtual leader and the quadrotor i is defined as a constant c; 
Gy; >0 represents that the virtual team leader can send information to 
quadrotor i, and &,; =0 otherwise. The nominal trajectory tracking control- 


ler is designed by the LOR feedback approach. Define K; = [Kos K, | as the 
LOR position controller gain. Let 


03x I 03x 
A, = 3x3 3 f Bz = 3x3 , 
03x3 03x3 I5 
Consider the design matrices Q; = Q} e R and T; =T} € R?*. As depicted 


in [52], the LOR position controller gain can be given by K; = DUBIB, where 
P, is the positive definite solution to the following Riccati equation as 


A; D, + PA, +Q, T B.B,U BID, = 0. 


Let Aj; (k = p,9) be the equivalent disturbances involving communication 
delays, which satisfy 


Api(t) = Api (t) + Apuj(t B pi) E Apuj(t), 
oi(t) = Aei(t), 
where 
Ai) = pe > Ôi (KpE) + Kopj(t)) + urapi (Kp, (0) K.p,t)). 
jeNi 


The term Ap,j(f — p1) - Aj(t) represents the mismatch resulting from the 
communication delays. 
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Remark 3.3 


It should be pointed out that p; represents the communication delays from 
quadrotor i to its neighbor quadrotor j, and the delays can be time varying. It 
can be seen that the communication delay is involved in the position control 
input, and thereby the global control system. 

Furthermore, from (3.6), if the ideal robust compensating input can be 
set as us(s) = - (B5 Y Aji(s), the effects of A(s) on the real model can be 


Lă 


counteracted completely. However, it is difficult to obtain A+;(s) from direct 
measurements. In this case, robust filters F,;(s) = diag(F,1,i(s), F,2,i(s), F,3,:(s)) 
are introduced, where F,,;(s) = fyi,i/(s+ fai) (=1,2,3) are robust position 
filters, where fp, > 0 represents the robust position filter parameter. It can 
be observed that if fj; ; (| = 1,2,3) are selected with larger positive values, the 
frequency bandwidth of the filters F,;(s) would get wider and the gains of the 
filters would be closer to 1. The influence of the equivalent disturbance A;;(s) 
can be restrained. Therefore, we can design the robust compensating input 
based on the robust filter as follows: 


uk(s)=—(BY)  Pi(S)Aj(S) (3.7) 


Lă 


However, it is not easy to obtain the equivalent disturbance A;;(s) directly in 
practical applications. From (3.2), one can obtain that 


A(t) = pi(t) oa! ByiUpi(t) + 8C3,3- (3.8) 
Substituting (3.8) into (3.7), one can obtain that 
21,(t) = — fzit) — foipi(£) + Bust) — 8655, 
Zbi(E) = — foiZ2i(t) + 2 fripi(t) + zu), 


u®(t)=(BN) fh pi), 


where z{,(t), z,(t)eR"* are the states of the robust position filters and 
fpi = ding | fpi} e R^? (i e TD). 

After uy(ieII) is determined by (3.3), the control input i, the pitch 
angle reference 0; (t), and the roll angle reference 6; (f) can be expressed as 
follows: 
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uzi(t) = Upsi(t) / cosó;(t) / cos8;(t), 
6} (t) = sin” ((upr(t) / us (f) — sin ó (f) siny;(t)) / cos@(t) / cosv;(0)), 
à (t) = sin ' ((cos¢,(t)sin 6;(t)sin y(t) - Up2i(t) / Uzi(t)) / cosy/(t)). 


3.3.2 Attitude Controller Design 
Similarly to the virtual position controller design, the attitude control input 
ue;(t) can be designed with the nominal control part u&(f) and the robust 
compensating part u&;(t) as follows: 

uo;(f) = uat) + uo. (f), i el. (3.9) 


The nominal control input uo,(t) is constructed as 


uA - (Bl) ((-Koeai(t) - Kuéo(t)) + (J*) C(6.0,6:)60.(0* 5,0), (3.10) 


where Ko, Ky € R^? are nominal controller parameter matrices. Denote 
Kr =|Ke, Ko] as the LOR attitude controller gain. Define 


03x I 
A= 3x3 3 

03x3 03x3 
Define Qr = Qk € R™ and Ta 2 T5 € R?? as positive definite and symmetric 
matrices. The LOR attitude controller gain Ka canbe obtained by Kz = TRB! Pp, 
where Px is the positive definite solution to the following Riccati equation: 

A} Pr + PRAR F Qr = PRB-I RB! Pr = 0. 
Similarly to u5 (s), ué;(s) can be constructed as 
REAL Ny , 
usi(5)= -(Bà) Fo;(s)Aei(s), 


where  Fe,;(5)= diagt fa, / (s + fo] €R?^? and Fo(s)= diag(Fe,;(s)) e RS 
with positive parameter fe; to be determined. Let fo; = diag fei] e R?9 
Then, one can obtain the realization of ué;(¢) in a similar way. 


Remark 3.4 


It can be seen that the feedback information of the controllers only depends 
on UAV's neighbors and itself, thus the proposed position controller and atti- 
tude controller of each quadrotor are distributed. 
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3.4 Robustness Property Analysis 
Combining (3.2), (3.5), (3.6), (3.9), and (3.10), one can obtain that 


X,(t) = 4Xņ,(t)- urBz X iK, (e — e, (0) 


jeNi 


— MpBz by Ko (ex(t) E es(t)) 


jeNi 
= got Bz (Kyei(t) + K.es(t)) 
+ Bz (Brut) + Ap), 
Xai(t) = AoXei(t) + Bz (Bust) + Aai(0)), 
where 
XP) = [ep e] -[x«6]e R*", 
Kald = [ep 50] -[xo..(] eR, ieri, 


and 


A= 03x3 I; 
-Ko -Ko 


Now, one can obtain the following overall closed-loop error system as 


X, (t) = A X, (£) + Byrd, (b, 
l (3.11) 
Xalt) Ag Xa(D4-BasAatf), 


where A, =| Biius(t) * ^5;(t) ]e R^", Ao =[ Bual) + Aalt) ]e R^", X,(t)- 
[X,(f) ] gm v Xo(t)= -[Xe(t) ] eR B, = diag {a,;} eRN* and 

Ape = In ® A, — Ur(L + B.) ® BzK;, 

Ag = ÎN ® Ao, Bpa = Boa = In 9 Bz. 


As described in Theorem 1 of [52], if the couple gain satisfy ur 2 97" / 2, then 


G hasa spanning tree and the information can flow from the virtual leader to 
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the root, where m = minien Re(0,;) represents the minimum eigenvalues of 


(L + B;). In this case, Ap. and Ag, are asymptotically stable matrices. 
The robust compensating inputs up(t) and ug;(t) are given in the state-space 
forms as 


z EI 
Xrui(t) = Anu (fui) X nu, (0) + coi (bii) AG i, 


(8.12) 
ug i(t) = =c} > fa X mu (D), k = P, 9;1 = 1,2, 3, 
where 
— fii 0 
A E 4) = i 
a | fu hu 
Let 


T 
Xap(t)=[Xkpi it), X), Xi] e RV, 
T 
Xro(t) = | Xzeox i(t), Xkez,i(t), Xkes i(t) | e RN", 
Define — X«0-[XI(0, X&(0] (kK=p,0) Let — Bu-Bu — Aa- 
diag {—c3 bii fui} e RONEN Ark = diag | Aru,i( fui) e REEN, By = 


diag cz, (0) e mov" (1=1,2,3), and At - [A&(D] e RN". From (3.11) 


and (3.12), the error model can be rewritten as follows: 
Xt) = ÀX (t) + BA, k = p, 9, (3.13) 


where 


A Aw. Bas " B 
Ay — ki kA4 1kA | B, — kA1 . 
Osnxon Arr By? 


Define A(t) and A(t) (l= 0,1) as continuous and uniformly positive func- 
tions with upper bounds [A44], and |A,4|. The equivalent disturbances A; 
and Ag are assumed to satisfy 


1 1 
JAE) < X hu E(t — p,(t))||+ bx" u(t- pilt))||+ Yu, k= p,9, 


I-0 I-0 
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where Neti = IL 


Auki = | Au 


tion involving the external disturbance dy, and 


|, and yy, is uniformly bounded positive func- 


md 


E(t)=[ep (6), e 5, e0), e] . 


From (3.5) and (3.9), the equivalent disturbances Ay and Ag can be rewritten 
by 


MOS Y Au |E(E— p) 
1=0 (3.14) 
+ bs Aui Cuz |E(t — pi(t))|+ fen Xr- pi(t))|) + Yea, 


1=0 


where = Xax(t) = diag(Xma(t), Xreo(t), Xma(t)), fim =| n and — A- 
\diag(Ky,K»,Ko,Ke)|. The communication delays satisfy p. = max; |pi||, « e 
< 1. Let po(t) = 0. Denote P; (k = p,0) as the solution to the 
Lyapunov equation: DÀ, t ALB, = —[j;y. From (3.13), one can obtain that the 


matrix A, is Hurwitz, and thereby P, is positive definite. There exists a posi- 
tive constant Ay. satisfying 


and Pae = max; |p 


L 


|e < Am fim k = p,8G. 


Define 


1 
ek = Y, nu, 
1 1 
eek = NETT T D, ladu, 
1 
Euk = > nu, 
1 1 
Sus = 2 Apr Aa + 2 Avg AutiAre , 
1 
Sali = 25 ML 


1 
uk = y EN ABk Acu 7 


ey = 2ÀncYyia- 
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Theorem 3.1 


Consider the quadrotor dynamics given by (3.1), and the formation control 
protocol developed in Section 3.3. If G has a spanning tree, the information 
can flow from the virtual leader to the root, for a given bounded and piece- 
wise continuous initial state E(t), v €[to — Pe, to], and a given initial time to, 
there exist constants falk = p,9) (k = p, 9) such that for any fri > fu, Ex(t) is 
uniformly bounded for i t >to. Furthermore, for a given constant e, there exists 
a constant T such that the state E(t) satisfies |E(t)|< e, Vt 2 T. 


Proof 3.1 Consider the Lyapunov function candidate by neglecting the 
communication delays as 


VX()- M. ORX. (3115) 


k=p,0 


By differentiating (3.15), one has that 


Vx) -- V (Eel HRA) Y. 2X PBA) 


k-p,O k=p,0 
s- È (Ef + ao) 61) 
k=p,0 
+ V (EOK) Aw fit JACI 
k=p,0 


Substituting the inequality in (3.14) into (3.16), one can obtain that 


VX- M a-& E fi EP 


k=p,0 
- M Q- Su Efi) Xe (0 
k=p,0 
+ Y. Es|E t7 of fi (17) 
k=p,0 
+ M Enea + M, En Xs Oft 
k=p,0 k=p,0 
+ 3 &s|Xut- p. 


k=p,0 
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Then, by introducing the communication delays, one can obtain the final 
Lyapunov function candidate as 


V(X(b),t)= V,(X(b) yD, a], NOE 


+> X ef |E. (7) i dt, 


k=p,0 


where éng and Eye are positive constants and satisfy 1— 2éne > ex, 1— 2ËNR > Eur, 
and 2(1— Pie)Enr > Sus. By differentiating the final Lyapunov function candi- 
date, one can obtain that 


V(X(t),t) s V (X(?) 


23 Ys (IE«Df -a-puolEC- p) —— G19) 


k-p,0 1=0 


>> F iulat - (1- Bi Xi t — po). 


k=p,9 I-0 


Let Ta = 1— 2ENg — Eek — Po Trk = 1— 2ENR — Ga — kun: Tesk = 2(1 -= Pae )ENE — 
Scope fin, Test = 2(1— Pac )ENR — Gus, and Tyr = Eyr fim. Substituting (3.17) into (3.18), 
one can obtain that 


VOAS- M rale,- Y^ zu [Xf 


k=p,0 k=p,9 


_ » "as |Xm (f — p (Df. — Dă LM 


k-p,O k=p,9 


+D lED Iza Xa) 


k=p,9 k=p,© 


Ert- pD? 619 


One can see that if fim (k = p,O) satisfy that 


fini > Eeg /(l—2one— 65a), 
fim > éu /(1- 2Enr "S eu), 
fim > Ses [2(1 — Pa)Ene k = p,O 


then Ta and mpg are positive and Ta, Tesk, and Typ are nonnegative. From 
(3.19), one can obtain that 
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V(X(0, « - M. ra ED + Y alEO] 


k=p,0 k=p,0 
- È relef + M. naX 
k=p,9 k=p,9 
(3.20) 
<- V (sa ze 
k=p,0 


- Y eum t em /2 


k=p,0 


From (3.20), one can obtain that the attractive radius of E(t) is determined by 
x / 2. In fact, if fim are sufficiently large, z,, can be made as small as possible 
and Tek — Tyk > 0 and Tr — Tyk > 0. Therefore, one can obtain that Theorem 3.1 
holds. O 


Remark 3.5 


It should be pointed out that the theoretical values of the robust filter param- 
eters fy (k = p,O) determined by Theorem 3.1 may be conservative, that is, 
the actual values of fy (k 2 p,0) may be much smaller than their theoreti- 
cal values. Since the tracking performances can be improved by selecting 
fii (k= p,9) with larger values, the robust filter parameters can be tuned 
online unidirectionally following this procedure. The first step is to set fo; 
with a certain initial positive value. The second step is to increase the value 
of fe; until the achieved attitude tracking performances are satisfied. The 
third step is to determine f,; in a similar way. 


3.5 Experimental Results 


In this section, the experimental results of a team of micro quadrotors are 
provided to validate the effectiveness of the proposed robust formation con- 
trol approach. The main onboard sensors installed at each quadrotor consist 
of a decentralized localization system using ultra-wideband radio triangula- 
tion (UWB deck) an inertial measurement unit module including a 3-D gyro- 
scope, a 3-D accelerometer with 3-D magnetometer, a laser sensor measuring 
the altitude of the quadrotor, and a Flow Deck measuring movements in rela- 
tion to the ground. The data from the inertial measurement unit and mag- 
netometer sensor are fused to estimate the attitude angles and angle rates 
of the quadrotors. The positioning system used in the experiment is a local 
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positioning system named UWB positioning system, and it is used to provide 
the current position of each quadrotor in the formation flights as depicted in 
[30]. The UWB system consists of a set of anchors and tags. The anchors are 
used as the position reference, and the tags measure the distance from each 
anchor to the tags. The information needed to calculate the position is avail- 
able in the tag which enables the position estimation on board of each micro 
quadrotor. The UWB deck contains tags, which are attached to the micro 
quadrotors expansion board and serve as the reference base for the position- 
ing system. Typically, 2.4GHz wireless modules are used for the communi- 
cation between the formation micro quadrotors and the ground client. The 
configuration of the experimental system is depicted in Figure 3.1. 

The nominal parameters of the trajectory tracking and attitude controller 
gains K,, K,, K,, and K, are tuned step by step as shown in the last para- 
graph in Section 3.4. The nominal controller parameters are selected by the 
following steps. First, u,, Kp, and K, are determined by using the LOR-based 
control method. Second, Ke and K, are chosen based on the LOR approach 
for better attitude performance of each quadrotor. The nominal parameters 
are selected as u, =3, K, =diag{1,1,1}, K, ={0.5,0.5,0.5}, Ke = {30,30,30}, 
and Ko = diag {15,15,15}. The robust compensator parameters are selected as 
fp i= diag{1,1,1} and fe, = diag{15,15,15} (i= 1,2,3). 


J 


2.4GHz 
Ground client wireless 


Onboard sensors 


Micro quadrotors Formation flight 


FIGURE 3.1 
Formation hardware system. 
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Based on the formation control protocol designed in the third section, 
three micro quadrotors are used in the time-varying formation flight 
experiments. The positions of the three micro quadrotors are required to 
realize geometrical configurations, and the formation center tracks the 
reference trajectory. The initial geometrical configuration is selected as 


&o-[-06 0.6 O[,c-[-09 09 OJ’, and¢3=[-0.9 03 0] m,and 
the ending formation geometrical configuration as gi = [-0.6 0.6 oF, 
Gu = [0.9 0.9 of, and 64-7 [0.9 0.3 of m. The reference trajec- 
tory of the formation center is a rectangle with O,; = [-0.6 0.6 0.6 |, 
O,2=[0.6 0.6 0.6], O, =[0.6 -0.6 06] and O,-[-06 -0.6 0.6] 
m as the four vertexes. The yaw angle reference y; of each quadrotor in 
the formation is set to be 0. The directed graph G=(V,E,W) is modeled 
to describe the information among three vehicles, where V = {v1,02,03}, 
E={(01,02),(02,03)}, and W = [w;] with w; =1 for (v;,v;) € E and 0 otherwise. 
Only quadrotor 1 can obtain the information from the virtual team leader, 
and thereby a, = 1, ap> = 0, and ps = 0. The sampling rate of a communica- 
tion sensor is 20 Hz. Therefore, one can obtain that the communication delays 
satisfy pe) < 0.05 s (k = p,O) and p, < 0.05 s. 

In these experimental results, dark gray, light gray, and black solid lines 
represent quadrotors 1-3, and the dotted line indicates the formation pattern. 
Figure 3.2 depicts the 3-D trajectory and formation geometrical configura- 
tions of the three quadrotors. In Figures 3.3 and 34, the longitudinal, lateral, 
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FIGURE 3.2 
Three-dimensional trajectories by the proposed controller. 
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FIGURE 3.3 
Position response by the proposed controller. 


and height position response and tracking errors are given, respectively. 
Figure 3.5 depicts the Euler angle response for the intuitive description. 
Then, a baseline controller developed from [32] is introduced for compari- 
sons, and its position tracking errors are given in Figure 3.6. It can be seen 
that using the proposed method, the longitudinal, lateral, and height errors 
are nearly 0.09, 0.08, and 0.04 m, respectively. However, by the introduced 
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Trajectory tracking errors by the proposed controller. 


leader-following controller, the longitudinal, lateral, and height errors are 
about 0.20, 0.25, and 0.08 m, respectively. It can be observed that the proposed 
global closed-loop control system can improve the formation tracking perfor- 
mance compared to the baseline controller. Besides, the effects of nonlinear 
dynamics, parametric perturbations, external disturbances, and communica- 
tion delays can be restrained by the proposed formation protocol. 
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FIGURE 3.5 
Attitude responses by the proposed controller. 


3.6 Conclusion 


This chapter presents a robust formation trajectory tracking controller 
design method to address the formation trajectory tracking control problem 
for a team of uncertain quadrotors subject to communication delays. For 
each micro quadrotor, a robust controller is developed consisting of a trajec- 
tory tracking controller and an attitude controller. Robustness properties are 
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FIGURE 3.6 
Trajectory tracking errors by a baseline controller. 


analyzed, and the tracking errors of the global closed-loop control system are 
proven to converge into a given neighborhood of the origin in a finite time. 
Experimental results demonstrate the advantages of the proposed formation 
control protocol. 


Taylor & Francis 
Taylor & Francis Group 


http://taylorandfrancis.com 


4 


Robust Formation Tracking Control 
for Multiple Quadrotors Subject 
to Switching Topologies 


In this chapter, the formation control problem for a team of quadrotors sub- 
ject to switching topologies is studied. The quadrotor model is underactu- 
ated and includes nonlinear dynamics, parameter uncertainties, and external 
disturbance. A distributed robust controller is developed, which consists of 
a position controller to govern the translational motion for the desired for- 
mation and an attitude controller to control the rotational motion of each 
quadrotor. Theoretical foundations and detailed simulation tests demon- 
strate the effectiveness of the proposed method. 


4.1 Introduction 


Research activities in the formation flight of unmanned aerial vehicles (UAVs) 
have increased substantially in the last few years. UAV formation flight can 
potentially be useful for increased surveillance coverage, better target acqui- 
sition, and increased security measures, as shown in [63—67]. 

Several studies investigate fixed communication topologies of multi-agent/ 
multi-UAV systems, modeled by first- and/or second-order differential equa- 
tions. In [68], a graph theory method with necessary and sufficient conditions 
to reach consensus with reference velocity was developed. In [24], an adap- 
tive output-feedback method was proposed to address the distributed time- 
varying formation control problem. In [69], the time-invariant formation 
control problem for multi-agent systems was investigated. A robust forma- 
tion protocol based on leader-follower was developed by combining a rela- 
tive localization strategy and a complex Laplacian-based formation control 
method [70]. A distributed control method designed by utilizing an artificial 
potential function was presented to guarantee formation performance [71]. 
In [72], a finite-time consensus problem for second-order nonlinear multi- 
agent systems under communication constraints was investigated. However, 
the dynamical models in above mentioned were linear; the formation control 
problems of nonlinear systems were not further discussed. 
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In [73], a leader-follower decentralized controller approach for multiple 
mobile robots was illustrated to achieve formation tracking. In [74], a dis- 
tributed adaptive control method based on backstepping was developed. In 
[14], the formation control problem of nonlinear multi-agent systems was dis- 
cussed, and a distributed formation control method was proposed. However, 
in [73-75], parameter uncertainties and external disturbance were not fully 
analyzed in the closed-loop control systems. In [16], a robust formation control 
protocol was presented and a suboptimal controller was designed to restrain 
model parameter uncertainties and external disturbances. But this method 
cannot suppress the influence of uncertainties in the whole frequency range 
as desired. In [68-75], formation control problems were discussed mainly 
based on fixed communication topologies, without considering switching 
topologies. 

It should be pointed out that in the above text, only formation stabilization 
problems for multi-UAV systems were addressed. In many practical appli- 
cations, such as source seeking and target enclosing, forming the desired 
time-varying formation is only the first step for a multi-UAV system. In such 
scenarios, time-varying formation tracking problems arise, where a group 
of followers keeps the desired time-varying formation while tracking the 
trajectory of the leader. Considering the fact that the interaction topology 
among the agents may be unreliable, it is more meaningful to study time- 
varying formation tracking problems for multi-agent systems with switching 
interaction topologies. 

However, formation control problems with fixed topologies are relatively 
easy to address, while problems with switching topologies are more chal- 
lenging. In [76], a simple controllability condition for the network subject to 
switching topologies was derived to indicate that the controllability of the 
entire network did not depend on each specific topology of the network. A 
consistent strategy for time-varying reference signals in multi-vehicle sys- 
tems was studied in [68]. The necessary and sufficient conditions for a linear 
multi-agent system to realize time-varying formation control are given in 
[77]. In [11], the time-varying formation control tracking problem was stud- 
ied subject to switched topologies for second-order nonlinear multi-agent 
systems. 

In this chapter, a robust formation control protocol is proposed for multi- 
UAV teams subject to switching topologies. The control law consists of a 
position and an attitude controller, which are both composed of a nominal 
controller designed to achieve desired tracking for the nominal system, and 
a disturbance estimating controller designed to restrain the effects of uncer- 
tainties and nonlinear dynamics. 

Compared with the previous relevant results, the contributions of this chap- 
ter are threefold. First, the considered quadrotor model is underactuated and 
has complete nonlinear and coupled dynamics. This model is more reliable 
and accurate when tackling quadrotor attitude and position changes from 
the perspective of dynamics. However, the quadrotor models were reduced 
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to second-order linear models, which cannot accurately describe quadrotor 
dynamics in [68-72]. Second, the interaction topology among the quadro- 
tors can be switched. The constructed multiple quadrotor systems that can 
achieve time-varying formation tracking are both necessary and sufficient. 
However, in [68, 70, 71, 72, 74, 75], formation control issues were studied based 
on fixed communication topologies. Third, the effects of parametric uncer- 
tainties, nonlinear and coupled dynamics, and external disturbances can be 
restrained simultaneously, which could affect the robustness properties and 
tracking performance of the overall control system. In [72, 74-76], uncertainty 
rejection problems were not fully discussed. 


4.2 Preliminaries and Problem Description 
4.2.1 Graph Theory 


Let G={Q,E,W} denote a weighted directed graph that describes the infor- 
mation exchange among n quadrotors. Q = (q1,q2,..:,4„) indicates a set of n 
nodes, where q; represents the micro quadrotor i. The influence relationship 
of the quadrotor i on the quadrotor j corresponds to one edge e; = (1;,4;) of G, 
which means that quadrotor i can access the information from quadrotor j. 
Let = (1,2,...,n). All the influence relationships between the quadrotors cor- 
respond to an edge set E c Ox Q, and W - [wj] e R"*” is the associated adja- 
cency matrix describing the strength of influence between the quadrotors. 
w; represents the weight value between the quadrotor i and the quadrotor j, 
which is the strength of influence between quad-copter i and quad-copter 
j. For any i,je(12,..., N], wj » 0 only if (4;,q;)eE, and w; =0 otherwise. 
The neighbor set of node i is depicted by N; = {qj €V:(gi,q) eE }. Define the 


N 
in-degree matrix as D = diag{d;} e R"*" with deg;,{v;} = >» Tl The graph 
E 


Laplacian matrix is defined as L= D- W. A sequence of ordered edges with 
the form of {(qi4a)/(Gar4v)r--1(Gu/9i)$ gives a direct path from quadrotor i to 
quadrotor j. If there exists a subset of the edges having a path from a node, 
called the root, to all the other nodes, G is said to have a spanning tree. 

The directed graph G discsued in this chapter can be switching, and the 
graph Laplacian matrix as L is time varying. Define the total formation flight 
time as tf. The finite time interval [0,t^) can be divided as a set of bounded 
intervals [ty,tm41)(m e 2), where Y represents all natural numbers. The dwell 
time 7 satisfies 0 <T (fi — tm) <t”, and the directed graph is fixed for the 
bounded interval [t,,t,.1). Let o(t) represent a switching signal. Define 


Wow = [w] w]e Rand N? = Lia, q;)€ E) as the weighted adjacency matrix 
and the set of neighbors of quadrotor i at o(t). Let Gow) and Low = Doa) — Wow 
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denote the directed graph at t and the Laplacian matrix at o(t), respectively, 
where Dow = diag( V" anl. If there is at least one node that have a path to 
j= 


all other nodes, the directed graph Goi has a spanning tree. 


4.2.2 System Model 


Consider N quad-copters modeled as rigid bodies. As depicted in 
[51], let Z;={Zy,Zy,Zi,} denote the earth-fixed inertial frame and 
Zpi = V ga, Zpy,Zg4] the body-fixed frame attached to quadrotor i with 
the origin in its mass center. Let 7; = [pu vi | eR™ represent the posi- 
tion and linear velocity of quadrotor i in Z,, where pi =[Pri Pri pul 
and 0; =[Upi Uy vj]. The attitude of quadrotor i is described by the 
four-element unit quaternion qi = [qo; qd eR”! to avoid the singularity, 
Pl and qi—[d ds qzi] €R?". The coordinate 


di 
transformation matrix R(4;) e SO(3), which brings Zg; to Z; and satisfies 
R(q;)R' (qi) = I5, can be given by 


which satisfies ga; + 


1- 205; 241i92i z 2doidsi 2thisi T 2goif2i 
R(q:) =| 2quiqai + 2qoiqsi Ee 20i; E 243; 2qoiqsi — 2qoifii 
2qiqsi -2qoidii — 2Gaiqai + 2qoitfii l= 2d 243; 
Each quadrotor model can be divided into a translational dynamics and a 


rotational dynamics. From [51], the translational dynamics of quadrotor can 
be given as 


Pii — Uii, 
(4.1) 
Uri = BsR(qi)uoics;s — 8633 + dr fir 
and rotational dynamics as 
R(q;) = R(qi)S(@i), 
(4.2) 


Qi = —J7'S(@;) Jia; + Prilli + da zi, 


where 9; -[O,; Oy 04] is the angular velocity of quadrotor i in Zi, 
Ui = [ui Up; u|, g is the acceleration of gravity, J; = diag! Jui, Jai, J3i} is the 
inertia matrix in Zg;, dr, and da; represent the influence of external distur- 
bance on the translational dynamics and rotational dynamics of quadrotor i 
in Z; and Z;, respectively, and Bg = kgm; I; and B,; = J; ‘diag (nck flick a, Keil, 
with kg, kri, lme and m; denote the model parameters. For quadrotor i, the 
inputs u; =[uo; thi Ww us] eR" can be described as follows: 
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2 2 2 2 
Uoi = Oni + Oni + Oni + On ai, 
2 2 
Uri = Omni — OR, Ais 
2 2 
Uzi = Oni — Oni, 


iE 2 2 2 
U3; = OR 1; — Oni t Oni — OR 4i; 


where op, ji(j = 1,2,3,4) represents the rotation velocities of rotors. 


Remark 4.1 


It can be observed that the quadrotor dynamical system is underactuated 
and the quadrotor dynamics involves highly nonlinearity and coupling. 

In practical application, it is difficult to obtain the accurate values of the 
vehicle parameters. Let the subscript N be the nominal parameter and the 
subscript A the parameter perturbations satisfying J; = JI + J?, B fi = p; + pg, 
and f; = Bi + Bå. Then, the nonlinear system model (4.1) and (4.2) can be 
rewritten as follows: 


Pii = Uii, 
(4.3) 
ii = BRE; — 9033+ Ari, 
and 
R(q;) = R(q)S(@;), 
(4.4) 


à; --(JP) S(@,)JN@; + BNT + Ari, 


where gi 2[gó; qu qzi qu] represents desired reference of quaternions, 

m ~ ~ ~ T 
F; = R(q; )uoica is the virtual position control input, F; =| Fi hi E, ] - 
uo(B5 Y” BgR(qi)cs — E, and Ar; and Ag; are called the equivalent disturbance 
satisfying 


Ari = BRE, + dr, fi, 


ARi -(?y!S(o;)]? o; - Ji'S(o;)];0; + Bat + da i. 


The nonlinear model (4.3) and (4.4) indicates the real model of each quadro- 
tor, and thus the nominal model can be obtained by ignoring Ar; and Ag; in 
(4.3) and (4.4). In fact, the quadrotor formation model is obtained to design 
the proposed robust formation controller. 
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4.2.3 Problem Description 


The objective of this chapter is to design a distributed formation control 
protocol for each quadrotor in the team such that the formation center of 
the quadrotors tracks a prescribed stationary trajectory and the group of 
quadrotors keep time-varying geometrical configurations. Define pj e R?'! 
as the reference trajectory of the formation center. po is differentiable, sat- 
isfying po = vp and pb = 03.1. Let 6 2-[Ó,; óy; ôzj]" be the desired position 
deviation between the quadrotor i and quadrotor j. In addition, the desired 
position deviation 6; satisfies 6; = 6; — ô; (i, j e ®), where 6; indicates the posi- 
tion deviation between the virtual leader. 


4.3 Formation Control Protocol Design 


For each quadrotor, the proposed robust controller subject to switching topolo- 
gies consists of a trajectory tracking controller to track the desired formation 
trajectory and form the time-varying geometrical configurations, and an atti- 
tude controller to govern the attitude angles in the rotational motion. Both the 
position and attitude controllers are divided into two parts: the nominal part 
to achieve the desired tracking of the nominal system and the disturbance 
estimating part to restrain the influence of uncertainties on the real system. 


4.3.1 Position Controller Design 


The virtual position control input F; is designed with two parts as 
E-E'€B, (4.5) 


where E" e R?" denotes the nominal position control input and F^ e R^" 
denotes the disturbance estimating input. The nominal trajectory tracking 
controller E subject to switching topologies is constructed based on a feed- 
back approach as follows: 


EN =ar D, wi (B) K,(ps- py - 9j) 


jeN? 


-ar V wi (By KOs- y) 


jeu? ® 
7 arpi BaN” K,(pu — 6; — po) 


= ar Bis) K,(vii — po) + (Bg) 8C3,3, 


(4.6) 


Multiple Quadrotors Subject to Switching Topologies 65 


where ar; denotes a positive scalar coupling gain, K,, K, e R?? denotes diago- 
nal nominal controller parameter matrices, and fj; represents the time-vary- 
ing connection weight between the virtual leader and quadrotor i. Bi; >0 
indicates that the virtual team leader can send information to quad-copter i, 
otherwise fj, = 0. 


Remark 4.2 


The nominal control input F is designed based on the feedback lineariza- 
tion technique to restrain the influences of the nonlinearities on the nominal 
closed-loop control system and to achieve the desired formation trajectory 
tracking and the desired formation pattern for the nominal translational 
system. 

Furthermore, the disturbance estimator F^ can be designed as follows: 


FA = -(B5) T s(s)Ari, (4.7) 


where T,;(5) = diag{T yy i(s)} = diag(rp;; / (8+ ni”) denotes the robust filters, 
with nji denotes a positive filter parameter. However, Ar; in (4.7) cannot be 
measured directly. Therefore, from (4.3), one can have that 


Ari = pr — BRE, + 8C3,3- (4.8) 
Substituting (4.7) into (4.8) yields the following realization for F^ 
BY; = -Np bi — MiP x + Bh Fi- 83,3, 
vs, = -Np Di F 2Npip i + oj, (4.9) 


F^ - (BYV n&(05- p.) 


where 97,97. e Rand Npi = diaginyj;) e R? are the robust filter states. 


Remark 4.3 


One can see that the robust filters I; (s) (j = 1,2,3; i e ®) have the property: 
if the filter parameter 7,,,; is larger, the frequency bandwidth of I; (s) would 
be wider within which the filter gain would get closer to 1. In this case, one 
can observe that F^ could follow the equivalent disturbance better and more 
influences of Ay; on the real system could be restrained. 
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4.3.2 Attitude Controller Design 


The attitude error, describing the discrepancy between the real quad-copter 
attitude and the desired one, can be obtained by a nonlinear function 


egi = Q(qi,qi ) satisfying 


—qoiti — qiifai T 92ioi + dsifi (4.10) 


| —qoiqi + quqoi + disi — Q5idoi 
—qoidsi + qiidoi — q2idai + 93:90: 


3 
Q(qi,qi) = | Sa 


j-0 


where q; denotes desired attitude. q; can be obtained by 


qoi cos(ġ; /2)cos(6/ /2)cos(y; /2) 
qii i sin(@; /2)cos(0; /2)cos(y; /2) 
g | | cos(i/2)sin(6; /2)cos(y! /2) 
qi cos(@; /2)cos(8; /2)sin(y; /2) 


sin(9; / 2)sin(6; /2)sin(y; /2) 
—cos(ó; /2)sin(6; /2)sin(y; /2) 
sin(9; /2) cos(0; /2)sin(y; /2) 
—sin(ó/ /2)sin(0/ /2)cos(y! /2) 


where @; is the roll angle reference, 6; the pitch angle reference, and y; the 
yaw angle reference. The desired attitude angle references can be given by 


0j =sin (F;sin y; /uo; — b; cos! / ui), 


8! = tan (RF; cosy} / b; + Fy sinw? / Fi), 


and Wi = 0, where Uoi = JFE + F + F " 
Similarly to F, the attitude control input u,; can be designed with the nomi- 
nal control part ui and the disturbance estimating part 15 as follows: 
Uri = UN ub. (4.11) 


The nominal control part u] is designed as 


us = (Bx Š (-K,ej fr Koloi + gi )!5(0;)J? o; ae ài ), (4.12) 
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where K,, Ku € R?? are diagonal parameter matrices and the angular veloc- 
3 d 

ity oi can be obtained by oj = 2sen( >) jin, Jor „di ). Furthermore, simi- 
j=0 


larly to E^, uz; can be constructed as 


us --(BY) ra()Au, (4.13) 


where the robust filter T.;(5)= diag(T ;;;(s)) = diag{nz;,: / (5+ naj) } e R^? with 
a positive filter parameter r];; ;. uñ in (4.13) can be realized similarly to F? in 
(4.9). 


Remark 4.4 


It can be seen that feedback information of the controllers only depends on 
its neighbors and itself; thus, the proposed controller subject to switching 
topologies of each quad-copter is distributed. 


4.4 Global System Analysis 


The robustness means that all states of the multiple quad-copters control 
system are bounded, and the tracking errors of each micro quad-copter can 
converge to a given neighborhood around the origin in a finite time under 
multiple uncertainties and switching interaction topology. In this section, 
theoretical analysis is provided to prove the robust stability and tracking 
performance of the multi-vehicle control system. First, the overall closed- 
loop error system is constructed to analyze robustness. Then, a theorem is 
provided based on the small gain theorem to prove the robustness properties 
of the constructed closed-loop control system. 


For ie 6, define ei; 2 [e;; emi] e R^" and es [ez ewm] € R^, where 


€pri = [ejrji] — Pri — Po zi 6; and CoTi = [eoi] = Pri = po. Combining (4.3), (4.4), (4.5), 
(4.6), (4.11), and (4.12), one can be obtained that 


1i = Apei; — OB, >» wi K, (epi =ty)— 0B, > wj K,(vr; — Pr) 
jeu? jeu? 
== Or BiB, (Ke pri + Keri) T B, (BREA + Ari), (4.14) 


E2i = Aga; + B.(Bziuz + Ani), 
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where 


03x I 03x I 03x 
A, = 3x3 3 „A, = 3x3 An » [| 
03x3 — Osa -K, -K, I5 
Then, the global deviation dynamics of the entire quadrotor group can be 
attained by the equations: 
6 = (Iu (23) Ap = Or (Lot) + BL) e B:Kr)e. + (In (23) B.)Ar 
= Ae, + BAT, (4.15) 


eo = (In 8 A, Je; + (In 8 B.) An = Axe; + Badr, 


where e; -[e;] e RÉ*, e, 2 [e] e R, B = diag(Bi) e R"", Kr — [K, Kol, 
Ar - [Bi F^ + Ar] e R?"**, and Ar =[BNud + Ari] e R”™!. The design matrices 
Qr = Qr € R* and II, =I; e R?? are positive definite and symmetric. At 
o (t), the controller parameter matrix K2 can be obtained by 


Ke ati BP, (4.16) 
where Pf? satisfies 
(A? y PPO + pO ATO + Qr — Pe OB TIT Bz Pr — 0, 
and Pf? is the positive definite solution of the above Riccati equation. The 


root of the directed graph Go« can get the relative information from the 
virtual leader, if Ga has a spanning tree. Therefore, at o(t), it is observed 
that A? is asymptotically stable if 


Apa yi 2, (4.17) 


where A754 7 minca Re(Ag) and n are the eigenvalues of (Low + BL). If there 
are positive diagonal elements in the diagonal matrices K, and Koe, one can 
be observed that A; is also asymptotically stable. Let A5(5(i = 1,2,...,n) repre- 
sent the ith eigenvalue of Log. As depicted in [79], the system gets consensus 
asymptotically subject to directed switching topologies, if the directed graph 
Go) has a spanning tree at M and K,-[K, Kə Ky] is a constant sat- 
isfying Kj > K o, Where K y= 20 ( j=1,2,3), if the n—1 nonzero eigenvalues of 


L;( are negative, and 


Ky= max | Zabel” cos(tan™ (Im(A;0) / Ref) ^ 
v Rea, «o and Im( Ai >0 


(4.18) 


otherwise. The dwell time 7 satisfies 7 > sup(Ds(y / Wow! at o(t). 
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Theorem 4.1 


Consider the quadrotor dynamics by (4.3) and (4.4), the proposed formation 
control protocol in the third section. If the directed graph Go always has a 
spanning tree, its root can get the information including position and veloc- 
ity from the virtual leader, and the initial states e,(0) and e;(0) are bounded. 
For a given positive constant £,, there exist the finite positive constants rj: 
and nr, such that if n, = min; /[1,,;] 2 Np and n = min;; {M;i} 2 n (ie 9), all 
states in the multi-quadrotors control system are bounded and e; and e» sat- 
isfy max; |ei/(f)| € e, and max;|es;(t) € £e, Vt 2 T. 
Proof 4.1 From (4.7), (4.13), and (4.15), one can have that 


lei. < mo], Yo ll, 
(4.19) 
ez]. < [moo], + Yos Anl. 


c(t) 
where zo = e^ 'ei(0), Tao = ee, (0), Ar = [Ar;] e Ro’, Ar = [Ar] e R, and 
Y Bp Y Bq satisfy 


x 


Yay = |(Slon — A" Ba (Ian —T,(5)), 


(4.20) 


x 


Bq = Slav a Aa) Ba (lsn ~ T. (s) 1 


L,(s) = diag(T,(s)) e R9", and T.(s) 2 diag(T.;(s)) e R?"?", Because AT? 
and A; are asymptotically stable and the robust filter would get closer to 1 
with the increase of the positive robust filter parameters 7; and 1,; (i e ®), 
Ysp and yg, can be made as small as desired by selecting the appropriate 


parameters of the robust filter. Define zo = maxUt;o,zt,o], ^-[AT ART, 
Ya = max(ys,, ys], and e=[e; ei] —[e;] e R7". There exist positive con- 
stants Zar and Tar satisfying 


|All, € Har el + Tar. (4.21) 


By selecting the disturbance estimator parameters n,; and n; (i e ®), one can 
have that ya < m4. Then, combining (4.20) and (4.21), one can obtain that 


lel, < t TTE, (4.22) 
1— VATIAT 


Since A? and A; are asymptotically stable and e(0) is bounded, it can be 
observed that e and A are bounded from (4.21) satisfying 


All, S ma, (4.23) 
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where m, is a positive constant. Besides, it can be seen that the position con- 
trol inputs F; and the attitude control inputs u,; (i e ®) and the states associ- 
ated with u$, FA are bounded. Therefore, all states of the closed-loop control 
system are bounded. Substituting (4.7), (4.13), and (4.15) into (4.23), one can 
obtain that 


max ex (t) < max (fa „e “e(0) +7 |All, (4.24) 


where A = diag( A1? , A2}. There exist positive constants pi and 771, such that 
forn, 2N,andn, 2 n (ie ®),e, and e; are bounded and satisfy max; e(t) < e, 
and max; 


e(t) € £e, Vt 2 T", respectively. 


Remark 4.5 


It should be pointed out that the filter parameters np; and 7,; (i € ®) deter- 
mined by Theorem 4.1 are conservative, which means that the actual values 
may be much smaller than their theoretical values. Therefore, in practi- 
cal applications, one can have the filter parameters using an online tuning 
method: first, set n; and 7,; with initial small positive values; second, run 
the global closed-loop control system; and third, increase 7,; and 7,; until the 
desired tracking performance can be achieved. 


4.5 Simulation Results 


This section will show the effectiveness of the proposed robust formation 
control method with switching topologies for a group of four quadrotors, 
whose dynamics is subject to underactuation, nonlinearities, and distur- 
bances. The four quadrotors are modeled as shown in Section 4.2 with 
g=9.81kg/s*, Bi = diag(9.2,9.7,15.99), J? = diag{0.109,0.103,0.0625} kg : m°, 
and p; = diag{1,1,1} (i= 1,2,3,4). The quadrotor nominal controller 
parameters are chosen as Qr = diag{0.06,0.06,0.06,0.1,0.1,0.1}, Ilr = I5, 
Qr = 1000"dia2 (2, 2, 2,1, 1, 1], IIa = I5, and at = 3. 

The directed graph considered here is switching in formation control of the 
four quadrotors. During t e [0,305], the topologies of the interactions between 
the four quadrotors are set as Goo), Gotroy and Goya), as shown in Figure 4.1. 
The weighted adjacency matrix W,() = [wiy] e R""" satisfies that 


Wo = [e(f) - e(t— 10)]W; [e(t — 10) — e(t — 20)]W, 
- [e(t — 20) — e(t — 30)]W5, 
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FIGURE 4.1 
Switching-directed interaction topologies. (a) Interaction topology G, (o) (b) Interaction topol- 
ogy Ge (10) (c) Interaction topology Go (20) 


where e(t) is a step function satisfying e(t) = 1, if t > 0 and otherwise e(t)= 0, 
and 


W, = „W = „W = 


ooo 9 
oo OF 
coro 
ooo _ 
oor oO 
coocc 
[e e 
oo OF 
oroo 
oo OF 
D O G 
ooo Fr 


The time-varying connection weight between the virtual leader and quadro- 
tor i is given by 


Bi=IBi Be Bis Bi] 
=[e(t)—e(t-10) &(t-10)-&(t-20) &(t-20)-&(t-30) 0]. 


The formation center reference of the multi-UAV system is given by 
po =[3t—0.01 2t-0.02t 3t]. The four quadrotors are required to 
maintain a constant quadrilateral formation pattern as 6,=[1 1 of, 
ó;-[3 1 0],ó,-[1 -1 O['andó,-[-1 -1 OJ’. The actual vehicle 
parameters are assumed to be 20% larger than the nominal parameters and 
the time-varying and external disturbance are given by 


dr, - (-1)[6sin(2t) 6cos(2t) 6sin(24)]', 
dg;;—-(-1)[0.3cos(f) 0.3sin(f) 0.3cos(#)]’. 
The initial positions and linear velocities for the four quadro- 


tors are selected as mn =[0:5 1 0 02 03 O4J, N= 
[-1 15 0 04 -02 02), n3=[1 -1.5 05 -0.3 -0.4 —0.3]", and 
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Na =[-0.5 -1.5 -1.5 -0.2 04 -03J[. The initial attitude and the ini- 
tial angular velocity are set as 4;(0)=[1 0 0 0]! and @g;(0) = 054. 

The trajectory tracking errors using the small disturbance estimating con- 
troller parameters with nj; = diag{0.17,0.5,0.37} and 1,;,; = diag{10,10,10} are 
shown in Figure 4.2. In the results, the solid line, hidden line, dotted line, and 
chain line represent quadrotor 1, quadrotor 2, quadrotor 3, and quadrotor 4, 
respectively. Furthermore, increase the values of the disturbance estimating 
controller parameters to 1), ; = diag{2.9,2,2} and n,;,; = diag{200, 200,200]. The 
3D trajectories of the four quadrotors are depicted in Figure 4.3. The linear 
velocity (Vixi, 0 yi, Vri) is depicted in Figure 44. The attitude responses based 
on the unit quaternions are depicted in Figure 4.5. The position deviations 
and the Euler angles of the four quadrotors are illustrated in Figures 4.6 and 
4.7, respectively. From these figures, one can observe that the tracking per- 
formance is improved by applying larger disturbance estimating controller 
parameters, especially for the vertical position channel. 
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Position deviations by initial small disturbance estimating controller parameters. 
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FIGURE 4.3 
3D trajectories by larger disturbance estimating controller parameters. 
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FIGURE 4.4 
Linear velocity by a larger disturbance estimating controller. 
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FIGURE 4.6 
Position deviations by larger disturbance estimating controller parameters. 
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FIGURE 4.7 
Euler angle responses by larger disturbance estimating controller parameters. 


In contrast, the proposed robust formation controller is compared to a 
leader-following formation controller developed in [70]. The trajectory track- 
ing deviations by the leader-following method are illustrated in Figure 4.8. 
The simulation results show that better tracking performance and robustness 
for the multi-UAV system subject to the uncertainties, external disturbance, 
and switching topologies can be achieved by using the proposed formation 
protocol. 


4.6 Conclusion 


In this chapter, the robust time-varying formation control problem 
is addressed for a set of quadrotors subject to switching topology, 
whose dynamics involves nonlinearity, parameter perturbations, and 
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Position deviations by the leader-following method. 


external disturbances. A distributed robust controller is developed consist- 
ing of a position controller and an attitude controller for each quadrotor. Both 
the position controller and the attitude controller involve the nominal con- 
troller achieving the desired tracking for the nominal system and the distur- 
bance estimating controller to restrain the influence of uncertainties on the 
real system. Robustness properties are analyzed and the tracking errors of 
the formation control system are proven to converge into a given neighbor- 
hood of the origin ultimately. The simulation results show the effectiveness 
of the proposed formation control law. 


D 


Robust Time-Varying Formation Control 
for Tail-Sitters in Flight Mode Transitions 


This chapter focuses on the problem of the robust formation control for a 
group of tail-sitters in flight mode transitions. Each tail-sitter dynamics 
exhibits the features of high nonlinearities and couplings and disturbances in 
both the translational and rotational motions. A robust distributed formation 
control method is proposed to achieve aggressive time-varying formation. 
For each tail-sitter, the proposed control method results in a composite con- 
troller that includes a trajectory tracking and an attitude controller to govern 
the translational and rotational motions, respectively. Theoretical analysis 
and simulation studies of the formation of multiple tail-sitters are presented 
to validate the effectiveness of the proposed formation control scheme. 


5.1 Introduction 


The formation control problem for a group of unmanned aerial vehicle 
(UAV) systems has attracted significant attention recently in multiple fields 
[9, 27, 80-82]. The usage of multiple UAVs can reduce the size and complexity 
required for each single aerial platform and hence lead to a more efficient 
and effective process. With the increasing demand for multi-UAV systems to 
cooperate and complete complex tasks, it is important to realize flight forma- 
tion in a robust manner for these multi-agent systems. However, formation 
flights present challenges including coordination and cooperation among 
vehicles, information interaction, communication protocols, and formation 
controller design. 

Tail-sitter UAVs have a number of advantages compared to other con- 
figurations [83-86]. In comparison to conventional designs they pose much 
greater operational flexibility because they don't require a runway for launch 
and recovery but instead can operate from any small clear space. Although 
rotary-wing UAVs share the same operational flexibility as the tail-sitter, 
they suffer from well-known deficiencies in terms of range, endurance, and 
forward speed limitations due to the lower efficiency of rotor. By marry- 
ing the takeoff and landing capabilities of the helicopter with the forward 
flight efficiencies of fixed-wing aircraft in such a simple way, the tail-sitter 
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promises a unique blend of capabilities at a lower cost than other UAV con- 
figurations. Previously published studies on tail-sitters [87-96] focused on 
attitude control or trajectory tracking control for a single tail-sitter. However, 
the formation control problem for multiple tail-sitters is still open. In practi- 
cal application, different formation patterns can be formed in vertical or hori- 
zontal flight using tail-sitters. When a group of tail-sitters takes off vertically, 
the formation pattern depends on the site conditions. In horizontal flight, a 
specific formation pattern can reduce air resistance and, thus, save energy. 
Furthermore, tail-sitters can enter the cruising state with the desired forma- 
tion pattern after the flight mode transitions as soon as possible. 

While the tail-sitter formation concept has great promise, it also comes 
with significant challenges. First, the flight mode transition of the tail-sitter is 
an aggressive flight phase between low-speed vertical flight and high-speed 
forward flight. Each tail-sitter is a multi-variable and under actuated complex 
system, involving parametric uncertainties, nonlinear and coupled dynam- 
ics, and external disturbances. Moreover, a group of tail-sitters is required to 
achieve different formations in flight mode transition, and thereby the for- 
mation is time-varying. Therefore, the aggressive formation control problem 
for multiple tail-sitters in the flight mode transitions is still open. 

Recently, different approaches have been developed for traditional mul- 
tiple vehicles to achieve formation flight control. In [38], an optimal controller 
was constructed for multiple classical fixed-wing UAVs. A robust formation 
control strategy was proposed in [44] for multiple helicopters to achieve the 
desired formation pattern. In [55], a distributed feedback formation control- 
ler was designed for a group of UAVs to achieve time-invariant formation 
flight. A model predictive formation control approach was presented in [99] 
for traditional quadcopters with nonlinear models to implement time-invari- 
ant formation tracking missions. In [100], a composite nonlinear feedback 
controller based on the leader-follower structure was developed for a group 
of typical quadrotors to keep a specified formation pattern. 

This chapter mainly investigates the formation flight control problem for 
the novel tail-sitter UAVs developed to achieve the desired time-varying 
formation pattern in the flight mode transitions. A robust formation control 
method is proposed for a team of tail-sitters. Compared with the previous 
relevant results, the contributions of this chapter are threefold. 

First, multiple tail-sitters can achieve the time-varying formation pattern 
in the flight mode transitions. Second, aggressive continuous flight mode 
transitions between the low-speed vertical flight and the high-speed for- 
ward flight can be achieved for a group of tail-sitters. The proposed control 
method does not require switching on the coordinate system or the control- 
ler parameters in different flight modes. Third, for the dynamical model of 
each tail-sitter, nonlinear and coupled dynamics, parametric uncertainties, 
and external disturbances are considered. The robustness properties of the 
constructed control system can be guaranteed and the tracking errors of the 
global system can converge to a neighborhood of the origin in a finite time. 
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5.2 Preliminaries and Problem Statement 
5.2.1 Model of Tail-Sitter Aircraft 


The schematic of a typical tail-sitter aircraft, as illustrated in [84], is shown 
in Figure 5.1. The tail-sitter UAV has a unique fixed-wing quadcopter hybrid 
design consisting of a fuselage, four rotors, coaxial counter-rotating propel- 
lers, two wings, and two ailerons. One of the main advantages of this con- 
figuration is that the quadrotors can control the attitude in both hover and 
transition flight modes. A typical flight process of the tail-sitter can consist of 
four phases: hover, hover to forward flight, forward flight, and forward flight 
to hover as shown in Figure 5.2. During vertical flight or hover, the model 
is similar to standard quadrotor aircraft. The main lift force is generated by 
the coaxial counter-rotating propellers, and the control torques are provided 
by the four rotors to stabilize the attitude angles. In the forward flight, the 
lift force is generated by the wings. Besides, the dominant thrust is provided 
by the coaxial counter-rotating propellers. The pitch and yaw dynamics is 
achieved by controlling Rotors 1-4 and the roll channel is controlled by two 
ailerons to save energy. 

When the vehicle is in the transition flight, the control torques are gener- 
ated by the differential force of the two pairs of rotors and the two ailerons. 


FIGURE 5.1 
Schematic of the tail-sitter aircraft. (1: Rotors; 2: ailerons; 3: wings; 4: coaxial counter-rotating 
propellers.) 
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FIGURE 5.2 
Formation schematics for a group of tail-sitters. 


As depicted in Figure 5.2, from hover to forward flight, the forces generated 
by Rotors 3 and 4 increase gradually, while the forces generated by Rotors 1 
and 2 decrease. Thus, the fuselage is sloped toward the horizontal, where the 
pitch angle is nearly 0°. Therefore, the flight speed of the aircraft increases 
gradually, and an angle of attack of the fixed wings would be obtained to 
generate a lift force to support the entire body weight. Then, the flight mode 
is switched to the forward flight mode to complete transition. From forward 
flight to hover, the aircraft is controlled to climb up and reduce the aircraft 
velocity by adjusting the rotational speeds of the four rotors. Thereby, the 
aircraft implements the transition from cruising flight to hover. 

Consider the tail-sitter formation Coon lu ulei system with two 
n the inertial frame E! = [o, ES Ey EA | and the body-fixed frame 


= P={0} (Bi E, E EL where OP is fixed at is center of the vehicle mass. The 


attitude vector is denoted as d; = [ 4; 0; Vi É where @; is the roll angle, 0; 
is the pitch angle, and y; is the yaw angle. Because the Euler representation 
suffers from the singularity problem, the unit quaternion representation is 
applied to describe the rotational dynamics in the flight mode transitions. 
We define q; = [dio di Ý, where Gj = [dà Qi» dis i and qio are the vector part 
and the scalar part of the quaternion, respectively, and satisfy q/ f: + qi = 1. 
The coordinate rotation matrix from S? to S! described by the quaternions 
can be given by 


Robust Time-Varying Formation Control for Tail-Sitters 81 


1-295; — 293; 291192 — 2qoidai 241193: + 2qoi9ri 
R;-! 2qiqi-t2qoisi 1-241, — 243; 22:43; — 2qoitfii 
241143: — 2qoi4ri 242i93i + 24oiqri 1-2qii — 243; 


For tail-sitter i, we define py = [Pri Pu Pri i as the position of the cen- 
ter of gravity in S', where pu; represents the longitudinal position, py; is the 
lateral position, and pu; is the vertical position. Let J; = diag (T.i, Jyi Jz) be 
the inertia matrix of the tail-sitter and m; be the mass of the tail-sitter. We 
denote v3; = [ vs Ugyi Upi [ as the velocity of tail-sitter i relative to S? and 


Oz = [ vs; Oy azi | the angular speed. We define g as the acceleration 


of gravity and m; the mass of tail-sitter i. Let the superscript x represent the 
cross product and c;,, an 1x1 column vector with one on the j-th row and 
zeros elsewhere for tail-sitter i. From [84], the dynamical model of tail-sitter 
i can be given as 


mifi = Ri (Fi + Foi + Fg +F,:)- Mj 8C3,31 


Jis; + 03; ];00pi = Tei + Tui + Tgi + Tai, 
(5.1) 


qi = 0.5q; ai + 0.5qoi0si, 


Qoi = -0.5o5iq;, 


where F; denotes the total thrust produced by the coaxial counter-rotating 
propellers and the four rotors, Fyi and Tu; denote the aerodynamic force and 
moment by the two fixed wings, respectively, F; denotes the aerodynamic 
force by the fuselage, 7.; represents the control torque generated by the four 
rotors and the two ailerons, 7,; is the moment generated by the gyroscopic 
effects, and Ej; and 74; denote the external disturbance force and moment, 
respectively. The moment T,; can be calculated by 


Tei = Tri + T, (5.2) 


where 7,; is the moment generated by the four rotors and 7,; is the moment 
by the two ailerons. F; can be obtained by F; = F; + E;, where E; is the total 
thrust generated by the four rotors and F, the thrust by the coaxial counter- 
rotating propellers. The forces E; and E; acting on the tail-sitter aircraft can 
be given as follows: 


T 
BX oi 0 ] ,F-[keài 0 Of, (5.3) 
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where k, is the thrust coefficient for each rotor, @ jj ( j=1, 2,3, 4) represent the 
rotational velocities of Rotors 1-4, respectively, ką is the thrust coefficient for 
the coaxial counter-rotating propellers, and @,; is the rotational speed of the 
coaxial counter-rotating propellers. The thrusts F; and F; satisfy the math- 
ematical relationship that E; =k gF,;, where ks is a positive constant. Fy; and 
Fg can be expressed as 


(Li; + La:) sin à; — (Dy; + D2;) cos ar; Ly sina; — D cos a; 
Fä = 0 7 Fg zd 0 
—(Lai + Lo;) cos O; — (Dii + D»;)sin O; -Lg COS Qr; — Dg sin Qa; 


(5.4) 


where L;; and Ly; are the lift forces, Dı; and D»; are the drag forces, and Lg and 
Dg are the lift and drag forces generated by the fuselage, respectively. The lift 
and drag forces acting on the tail-sitters can be calculated as 


Lj = 0.5CySsp(vis + vis), 

Dj = 05Cp;Ssp(visi + vis), 

Ls = 0.5CgSgp(vi + vis), 

Dg =0.5C Sp P( Vas + vis), j= 1, 2, 


where S, is the reference area, p is the air density, 5; is the blade area, and Cri; 
Crair Cori, Cozi” Cj; and Cay; are the thrust or drag coefficients. These aerody- 
namic coefficients are related to o; and can be obtained by 


Cui = Croi + Crai Oi + Crai Oi, 
Cpj; = Cpoi + Ci; /as , 

Cy; = Cfo Qi, 

Cag = Caroi + Cafai i, f= 1, 2, 


where Cro; Chair Choir Cpoi, Ciai, Cafoi and Caja; are the aerodynamic coefficients, 
03; and 6»; are the flap bias angles, and a, is a positive constant. Moments T,; 
and T,,; acting on the tail-sitter aircraft can be obtained as follows: 


»3 B (3) (ani + V2a2il1i/2) 0% 


ja 
Tri =] lui [Fai + Fri — Frsi — Fra: ]/2 j (5.5) 
la [-Fai + Fo; + Es — F,4;|/2 
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and 


lyzi (Ly; -Lyi ) COS (t; + Le»; (Də; -Dij ) sin a; 
Twi =| loi (Ly; + L,;) cos O; + Lazi (Dy; +D,;)sin a; |, (5.6) 


li (L5; = Lii ) sin a; tL»; (Di; - Di )cos [7 


where da; and 4;;; are positive constants, Ia; is the distance between two 
rotors, l,2; is the distance between the center of gravity of the aircraft and the 
force acting position of the fixed wing, and l;;; is the distance between the 
center of gravity of the aircraft and the fixed wing. 7,; can be expressed as 


2 2 
l;;;|CroiS,p cos ar; (vk; + UBzi ) (0; ES 05i) 
2 2 
Tai = | laCiiSipcosa; (vis + Uhai ) (Ori + 05i) . (5.7) 
0 


Tg; can be obtained by 
4 . , 
Toj = by . NL (31) Oji, 
j= 


where J,; is the rotating inertia of each rotor. 


Remark 5.1 


It can be observed that the vehicle system is highly nonlinear and strongly 
coupled. The coordinate system of the tail-sitter system is consistent in every 
flight mode. 


5.2.2 Control Problem Statement 


We define à; = [ôx ó, Oxi I e R* as the desired time-varying position 
deviation between tail-sitteri and tail-sitter j, which determines thetime-vary- 
T 

ing formation pattern of the tail-sitter group. Let po = [ pio Pyo pro | eR™ 
as the prescribed desired trajectory of a virtual leader, where its second 
derivative ji) is assumed to be bounded and could converge to 0 in a finite 
time. We denote ó; as the position deviation between the virtual leader and 
tail-sitter i and it follows that 6, = ô; —ó;. The control goal in the current chap- 
ter is to propose a robust distributed control protocol to achieve the desired 
time-varying patterns and track the desired formation trajectory. 
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From the first and second equations in (5.1), one can have that 


pi =m;'R; (Ei) m; R; (Fu + Fs -- m; R;Ej— $655, 
(5.8) 


à; 2 —]i os] ini + Ji ta]; (tui *Ta)* Ji Tai. 


Let B; 2 m; I; and By = ];!, where I, represents an nxn unit matrix. We 
define the superscript N as the nominal parameter and the superscript A 
as the parameter uncertainty. Then, one can have that B,; = Bj; - Bj; and 
qi = Bj + Bs. We denote the attitude control input thi = t; and the virtual 
position control input up; = R;F;. The dynamics of tail-sitter i in (5.8) can be 
rewritten as 
Pr = Bpiuy + BYR; (Fui + Fg) 8C3,3 + Api, 
(5.9) 


, N N N N 
Oni = —Bjj Obi]; Opi + Bai Uai + Bai (tu + Tai) + Ai, 


where Ay, A; are named the equivalent disturbances including the 
parametric uncertainties, nonlinear and coupled dynamics, and external 
disturbances and have the following forms: 


Ay; = B&R;F; + BAR; (Foi + Fg) mi RiEu, 
(5.10) 


^ ^ N ^ ^ NY 
Azi = B,osiJi Oi + Buosi]i Opi + Bits; + Bj (tai + Ti) +(J} ) Tai. 


Remark 5.2 


It should be noted that the tail-sitter system is a complex system subject 
to multiple actuator faults, highly nonlinear and coupled dynamics, exter- 
nal disturbances, and parametric uncertainties, which pose challenges for 
the fault-tolerant formation controller design. By ignoring Ap and Aj, the 
model in (6.12) represents the nominal model. The real vehicle model can be 
regarded as the nominal model added with Aj, and Aja. 


5.3 Robust Formation Controller Design 


In this section, a robust formation controller is designed for the team of tail- 
sitters to achieve the desired time-varying formation scenario. The overall 
controller design is divided into two parts: the trajectory tracking control- 
ler design to govern the translational dynamics with the desired formation 
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trajectory and pattern and the attitude controller design to stabilize the inner 
rotational dynamics. 


5.3.1 Trajectory Tracking Controller Design 


For tail-sitter i, the position control input uj; is designed as 
EET 6.11) 


where up; denotes the nominal control input and uj; denotes the robust com- 
pensating input. The nominal controller based on the state feedback con- 
trol method is designed to achieve the desired tracking performance for the 
nominal position system by ignoring the equivalent disturbance A,;, while 
the robust compensator is introduced to restrain the effects of A,j. 

The nominal control input is constructed as 


pir 


upi --A(Bi) K, Y w;(p:-p; -ój)* ks(pi 8; pb) 


jeNi 


-A (BX) Ky] X wy (pi-pj-3y)+ka(pi-d:—p5)} 613 


jeNi 
—Ri (Es +F,)+(BN) (cs +8), 


where A; represents the coupling gain, K, and K, are the nominal controller 
parameter matrices, and k,; is the connection weight between tail-sitter i and 
the virtual leader. k; > 0 means that tail-sitter i can receive the information 
from the virtual leader; otherwise, ką = 0. 

Moreover, the robust compensating input up; can be constructed by the fol- 
lowing form: 


uk (s)=—(BN) | Fs (s)Ay (s), (5.13) 


where s is the Laplace operator, E; (s) = diag { Fyin (s),Fri2(s),Fris (s)}, and the 
robust filters E; (s) = fy ji (s + fpi i (j=1, 2, 3). In fact, larger robust compen- 
sator parameters fi ( j=l, 2, 3) lead to wider frequency bandwidths of the 


robust filters Fj; (s) (j=1, 2, 3) and the robust filter gains are closer to 1. In 
this case, the effects of the equivalent disturbance A,; would be restrained, 
as illustrated in [62]. In practical applications, the equivalent disturbance Ay; 
cannot be measured directly. Therefore, the robust control input Ws does not 
depend on A,;. From (59), one can have that 
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Ay; = fii — BuUpi — BNR; (Foi + Fa) + gcaa- (5.14) 


From (5.13) and (5.14), one can obtain the realization of the robust compensa- 
tor as follows: 


Tli =— fpMpui — fpiPu + Bip: + Bg Ri (Fas +Fa)- $653, 
Tpai = —foiMpri + 2 fpiPri + Tli, (5.15) 
up - (Bi) fa (mapi); 

where np; and 7,2; are filter states and fp; = diag | fon, firs fris - 


5.3.2 Attitude Controller Design 

For tail-sitter i, the attitude reference is denoted as q,; = [qori Qiri dodi Qari f. 
nd T: 

We define the attitude tracking error epi as ey; = [ eo; oi f = [ 9: Qpi — Obi ] ; 


where Q; is the attitude error based on the quaternion representation and cj; 
is the desired angular velocity. The nonlinear function Q; can be given as 
follows: 


A —GoiGrri + Qiiori + Q2id3ri — 13if2ri 
O(q;, qi) =2 sen >) 2 —tQoiq2ri — qiias + qoigori + qaitfvi 
—qQoid3ri t Qaid2ri — Qoitiri + 93i4ori 


The desired angular velocity op; can be obtained by 


Opi = 05|-a, (ails a2) Jio The error dynamics of the rotational sub- 


: aT quss . 
system can be given as: ja; = [ os; — pi Opi - às, | . Similarly to the trajec- 
tory tracking control input u,; the attitude control input u,; also involves the 
nominal control input uy and the robust compensating input u as follows: 


ug =U] uf. (5.16) 
wu; can be designed as follows: 
uN -(BY) (-K.eg - Kies; + ob) o] os (Tai + Tu). 61) 
Furthermore, u£ is constructed as follows: 


uk (5)= (BN) Fy (s) Au (s), (5.18) 
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where the robust filter satisfies F,;(s)=diag {Fri (s), Fo (s), Eis (s)] and 
Ej; (8) = fs; | (s+ wu) ( j=1,2,3). The implementation of u; is similar to that 
of u as follows: 

Tai = — füflai — uei + By Uai = Bi os]? Opi + By (tui + Tgi) Opi, 

Nari = — fatlaai +2 falig + Thai, 


ug = (Bj ) fa (nazi = eio), 


where Nai and rj»; are filter states and fri = diag { fai fair, fus] 


Remark 5.3 


The designed controller is continuous in the flight mode transitions. There 
is no need to switch the controller structures or the controller parameters. 
Besides, the proposed fault-tolerant time-varying formation control strategy 
is distributed because the designed control law of each tail-sitter depends on 
the position and velocity information from its neighbors and itself. 


Sa 
5.4 Robust Property Analysis 


Define the trajectory tracking error ep; = [ey;;] ^ pii — 6; — po and emi = [es é | 
From (5.9), (5.11), (5.12), (5.16), and (5.17), one can obtain that 


rpi = Arpl rpi — AB Ky b Ui (ey; - ey) + d 


jeNi 


— A;BiaKj P» = ej) z Bu (Brus + Api = po), 


jeNi 
Ckai = AgaCkai + Bia (Brus + Azi ji (5.19) 


where 


Ay, = 03.3 I; "T = 03x3 I; Bs = 05.5 ; 
Osxs — Osa -K, -Ki I5 
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and 


03x 
Bu -| a= | 
I5 
Then, the overall closed-loop error system can be written as 


by = Apep + Bia (BNuk + Api — jo), 
(5.20) 
en = Aaea + Bo (Byun + Aci), 


where e, = [es] e RN! e, = [ey] e RN”, and 


A, = In 8 Ay -A (L- B.) 8B,K,, 
A, = ÎN 8 Aja, Br = In 8 Bn, 


with B; = diag[k;] e RY" and K,= [K, K; ] One can observe that the 
matrix A, is asymptotically stable by selecting proper diagonal gain matrices 


K, and K; with positive diagonal elements. If the directed graph G has a span- 
ning tree, the root can obtain the information from the virtual leader, and 


A; 2 0.5Apm, the matrix A, is asymptotically stable, where Apn = min Re (A) and 
Ani is the eigenvalue of (L-- B;)). Let A, = [^s] e R?"*! and A, 2 [Ax] e RY. 
One can have that 


le, < HpoAo + Tipo + Up la, j 


(5.21) 
le. || S Tao + a A]. , 


where 


9 T Apt 
7 po=Max  SUpiso Ceu, je” e, (0) 


7 


7 


Con, je "e, (0) 
po,;(£) 


Hy = (slo — A) Bo (Ix -F (s)) 


7q0=Max ; SUpizo 


Ay = max; supiso 


7 


7 


Robust Time-Varying Formation Control for Tail-Sitters 89 


7 


Hypo = (stes -A, ) Bo 


1 


7 


Ha = Tex — A, y Bkz (Ia — Fa (s)) 


1 


7 


Ha = (ste — A, ) By; (Ix =F, (s)) 


F, (s) - diag |F,;(s)] and F,(s)=diag{F,;(s)}. According to [62, 101], there 
exist positive constants fj; and f; such that if fym 2 f; and fam 2 fa, then 
one can have Lt, S Àp / fam, Ha SAa/ fam, ANA Hpo S Apo, where fym = min; { hi 


fom = ming { fa j=l, 2, 3), and Ap, Aa, and Apo are positive constants. 


Theorem 5.1 


Consider the nonlinear dynamics of each tail-sitter given in (5.1) and the 
formation control protocol as shown in (5.12), (5.13), (5.17), and (5.18). If the 
directed graph G has a spanning tree, the root can receive the information 
from the virtual leader; then, for the initial bounded conditions e, (0) and 
e, (0) and given positive constants £, and e,, there exist positive constants f;, 
fa, and T", such that if f; 2 f, ( j=1, 2, 3) and faj > fr, then the tracking 
errors involved in the global closed-loop control system are bounded and 
satisfy that max; legi; (t) < e, and max; le; (t) €g,VE2T'. 
Proof 5.1 From (5.10), one can have that 


Iw 


^ 
.sIBs 


i RE + BAR: (Fu + Fi ) tm; RE 


|. 
loo 


(5.22) 


S Xapi | Ui li + X api2- 
where Xai and Xai are positive constants. By substituting (5.12) and (5.13) 


into (5.11), one can obtain that 


lu; Ll S Xupin jerpi | + Xupi2 JApil + Xwis; (5.23) 


where Yupit, Xupiz and x,,/5 are positive constants. Combining (5.23) and (5.22) 
yields that 


|^ 


F X Aui2 y (5.24) 


oo 


< X Auil 


pi - 2" 
where Xa and Xa» are positive constants. Let Yan = Max; aun and 


Xx = max; X Aui2. From (5.24), one has that 


lal, S Xan el + Van: (5.25) 
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If fom 2 fp, such that fom 2 ZauiAp, one can yield the following inequalities: 


X Aul T o tApoAo + Xau2 
P 
-1 
IY uis pm 


Il s 


7 


(5.26) 


le | < Tyo + Apo do + Ap fon Xu 

ie 1- XanAp fom 

Since 7,9 is bounded and the matrix A, is asymptotically stable, and the sec- 
ond derivative py of the virtual leader trajectory is bounded and can converge 
to 0, there exist positive constants Ey and Eep such that 


|As, S Ex, eon 
fell S Ex- | 
From (5.21) and (5.27), one can obtain that 
max, e, (f) € max; cen ee, (0) + fomApErp + Apoo. (5.28) 


From (5.28), one can see that for the initial bounded conditions e, (0) and 
e, (0) and given positive constants £, and £,, there exist positive constants 
f, and T", such that if f, > f, ( j=1, 2, 3), then the tracking errors involved 
in the global closed-loop control system are bounded and satisfy that 
max; lei; (t) Ses Veer 

Then, the robust properties of the attitude control system are proven. From 
(5.10), one can obtain that 


JA. S Y vil lex F X haiz erai]. F X Aai3 uil. T X wid; (5.29) 


where Y aii, Xiz Ani, ANA Y mi4 are positive constants. From (5.16), (5.17), and 
(5.18), one can have that 


[fail < X uail eri]. za Xuai2 JA... + Xuai3 š (5.30) 
Combining (5.29) and (5.30) yields that 


[Asillo < Xain erail, + cei eta. + Xais (5.31) 


where X4, Xaci2, and xai, are positive constants. Let X44 max; X seiv 
ror = MAX; Y wei», ANd Y 4e3 = max; Y acis. Then, from (5.31), one has that 
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Asl. S Xu lleak + Zae leall + taca: (5.32) 


If the following inequality holds 


Heer lll. Xen S (As + Ma), (5.33) 
one can have the following equation by substituting (5.21) into (5.32) as: 
oll, < zo/ tta +(1+ tts ) Zas. (5.34) 
From (5.21) and (5.34), it follows that 
ealla < Tao (1+ fs )+ tare (1+ Jp )- (5.35) 


For (5.33), one can obtain the attractive region of e, (t) as 


-1 
fea (£): leaa < zh (to + Re) Z7 (5.36) 


From (5.34) and (5.21), one can have that 


max, e, (f) € max; lcs ke e; (0) t (7 Xa) fam Aa + 


where y42 (1+ n IN Ha Xas. From the above analysis, one can observe 
that there exist positive constants T" and f}, such that if fui > f, ( 112,3) 
the attitude tracking error of the global system satisfies that max, eui, i(t) < 
£&, VEZT.. 


Remark 5.4 


It should be pointed out that the theoretical values of the robust filter parame- 
ters fpj and fai; ( j=1, 2, 3) determined by Theorem 5.1 may be conservative; 
that is, the actual values of fpj and foi ( j=l, 2, 3) may be much smaller than 
their theoretical values. Since the tracking performances can be improved by 
selecting fpj and f, ( j=l, 2, 3) with larger values, the robust filter param- 
eters can be tuned online unidirectionally following this procedure. The 
first step is to set f, and fai ( j=l, 2, 3) with a certain initial positive value. 
The second step is to increase the value of fj; and fai ( j=l, 2, 3) until the 
achieved attitude tracking performances are satisfied. 
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5.5 Simulation Results 


In this section, the time-varying formation flight tasks are carried out to 
check the tracking performance of the proposed robust control method. The 
nominal model parameters of the tail-sitters are selected according to [84]. 
The desired trajectory of the virtual leader is given as: pj) =0, and 


0, t €10, 


Pxo=3 #2—20t+100, 10«t € 20, 
20t — 300, t » 20, 


t, t€10, 


pis = 40 — 30g 9250-10? , t»10. 


At the beginning of the formation mission, the four tail-sitters take off verti- 
cally ina diamond. Then, theformation pattern is converted from the diamond 
to one shape in the flight mode transition from vertical flight to level flight, 
which can save switching time and reduce flight resistance. The interaction 
topology of the tail-sitter formation system is modeled by a directed graph 
with the node set V = {v1, v2, V3, v, }, the edge set E = {(v4,03),(3,02),(02,01 )b 
and the weighted matrix W = [w T If (vi, v;) € E, then wj = 1 and wj = 0, oth- 
erwise. In the simulation tests, tail-sitter 1 can directly obtain the position 
and attitude information from the virtual leader; thereby, ka =1, ke2 =0, 
k.3 = 0, and k,4 = 0. Each real vehicle parameter is assumed to be 23% larger 
than its nominal value, respectively. The periodic and non-vanished external 
disturbances acting on tail-sitter i are given by 


7 sin(2t)+11cos(t) 
Fj, =| 10sin(3t)+18cos(t) |, 
9sin(t)+20cos(2t) 
7.5 sin (3t) 4 2.4cos(2t) 
Ta =| 75sin(t)+7 cos(3t) 


10 sin (2t)+8cos(3t) 
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In the flight task, the initial conditions of tail-sitters are pe as 


pn(0)=[0 4 o], pr(0)=[4 0 of, pa(0)=[0 -4 of, pu(0)- 
[4 0 of , and qi ( E 0 e o]. The nominal controller 
parameters are ala as = diag {149.5,149.6,149.6}, | K;- 
diag {104.7,149.6,102.6}, K, = diag T and K, = diag{1.2,1.2,1.2}. 
The robust compensator parameters are determined as fj; = 1000, f,;; = 1000, 
fois = 1000, fain = 50, faiz = 50, and friz = 50, as shown in Remark 5.4. The time- 
varying formation flight of the four tail-sitters with the desired deviations 
can be determined by 


[0 4 0f, t<10, 
ô -— 
' | [o 6-2e op, £210, 


[-4 0 Of, t<10, 
6 — 
i [a a o[, t 210, 


[D —4 Of, t<10, 
6 — 
j [o 24-6 of, #210, 


[4 0 of, t<10, 
ô — 
‘ [ae 2549-2 0], £210. 


Figure 5.3 illustrates the 3-D trajectories of the multiple tail-sitter system by 
the proposed robust control method. Figures 5.4 and 5.5 show the attitude 
and position response using the proposed robust method, respectively. The 
trajectory tracking error is shown in Figure 5.6. In contrast, the proposed 
robust controller is compared with the baseline nominal controller (see [55]) 
by ignoring the robust compensating inputs in (5.11) and (5.16). The attitude 
response is depicted in Figure 5.7. The trajectory tracking error by the base- 
line controller is shown in Figure 5.8. From these figures, one can see that the 
proposed robust controller can achieve the predefined aggressive continuous 
time-varying formation under the influence of the parametric perturbations, 
coupling, nonlinear dynamics, and external time-varying disturbances. The 
tracking performance of the proposed robust controller is improved com- 
pared to that by the baseline controller. 
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FIGURE 5.3 
3-D trajectory tracking by the proposed robust controller. 
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Attitude response of the proposed robust controller. 
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FIGURE 5.5 
Position response of the proposed controller. 


5.6 Conclusion 


This chapter addresses the time-varying formation protocol design prob- 
lem for a group of tail-sitters subject to underactuated, highly nonlinear 
and strongly coupled dynamics, and disturbances in aggressive flight mode 
transitions. A distributed robust formation controller is proposed based on 
the robust compensation theory. For each tail-sitter, the proposed controller 
results in a trajectory tracking controller and an attitude controller to govern 
the translational and rotational motions, respectively. The tracking errors of 
the proposed global closed-loop system can be guaranteed to converge to a 
given neighborhood of the origin in a finite time. Numerical simulation stud- 
ies are provided to demonstrate the effectiveness of the proposed formation 
protocol scheme. 
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FIGURE 5.6 
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Trajectory tracking errors by the proposed robust controller. 
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Attitude response of the baseline controller. 
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Trajectory tracking errors by the baseline controller. 
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6 


Robust Fault-Tolerant Formation 
Control for Tail-Sitters in Aggressive 
Flight Mode Transitions 


This chapter investigates the fault-tolerant time-varying formation control 
problem for a team of tail-sitters in the presence of unknown actuator faults 
and uncertainties. A robust distributed and continuous fault-tolerant forma- 
tion control method is proposed to achieve aggressive time-varying formation 
flight in flight mode transitions. For each tail-sitter, the designed controller 
is divided into an outer position controller and an inner attitude controller 
to govern the translational and rotational motions, respectively. It is proven 
that the formation system stability can be guaranteed under the effects of 
actuator faults and uncertainties. Simulation results of the formation flight 
are given to show the effectiveness of the proposed control method. 


6.1 Introduction 


The formation control of unmanned aerial vehicles (UAVs) has gained consid- 
erable interest from various potential application fields, such as border surveil- 
lance, forest fire detection, and power line inspection (see [102-105] to mention 
a few). Cooperation among multiple UAVs has potential advantages of greater 
flexibility and higher performance over a single-body UAV. However, faults 
may occur frequently in the group of UAVs, and any failure may easily dam- 
age the formation system or even cause catastrophic accidents. Therefore, the 
safety and reliability of multi-vehicle systems are important and the develop- 
ment of a fault-tolerant formation control scheme is a necessity [106-111]. 

Recently, a special UAV concept, called tail-sitter UAVs, has been widely 
developed in the academic and industry as depicted in [83, 84, 86, 88, 112, 
113]. Aerial vehicles have the abilities of high-speed cruising like a fixed- 
wing aircraft and vertical take-off and landing like a rotary-wing aircraft. 
They can perform in three flight modes: vertical flight, transition flight, and 
horizontal flight. Therefore, tail-sitter UAVs can accomplish a wider range 
of missions, compared to conventional fixed-wing aircrafts or rotary-wing 
aircrafts. 
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Multiple tail-sitters may operate following three formation flying modes 
ranging from vertical formation, transition formation, and cruising forma- 
tion. For vertical formation, the take-off formation pattern may be adaptive 
to their surroundings, like the conventional quadrotor formation. In addi- 
tion, a specific formation pattern can reduce air resistance in the cruising 
formation mode, like the traditional fixed-wing vehicle formation. In the 
transition formation mode, the formation pattern is required to change, and 
the team of tail-sitters needs to quickly enter the forward formation mode. 
However, the formation control protocol design is challenging for tail-sitters, 
especially in the transition formation mode. First, the tail-sitter formation 
pattern is required to perform the continuous flight mode transition, which 
is an aggressive flight process. Each tail-sitter is an under actuated complex 
system, involving parametric uncertainties, nonlinear and coupled dynam- 
ics, and external disturbances. Second, the tail-sitter flight controller is sensi- 
tive to multiple actuator faults in the flight mode transitions. Moreover, in 
the aggressive flight mode transitions, it is difficult to define the coordinate 
systems to describe the dynamics of the tail-sitters and design a continuous 
control law for different flight phases. 

At present, many aforementioned approaches mainly focused on conven- 
tional UAV formation control with actuator faults. In [114], a consensus-based 
formation control method was proposed for multiple quadrotors subject to 
actuator faults. In [115], a robust adaptive control method was constructed for 
a group of typical quadrotors to achieve the desired time-invariant formation 
configuration under the effects of actuator faults. In [116], a fault-tolerant con- 
trol strategy based on a leader-follower structure was developed to achieve a 
fixed formation pattern for a group of fixed-wing vehicles subject to actuator 
faults. In [117], a distributed sliding-mode controller was designed for mul- 
tiple fixed-wing UAVs to deal with actuator faults. In [118], a fault-tolerant 
formation control design strategy was developed to overcome actuator faults 
in formation flight for a team of typical fixed-wing vehicles. In [119], a coop- 
erative control strategy was developed for multiple 3-DOF helicopters with 
actuator faults to achieve time-invariant formation patterns. Although sev- 
eral fault-tolerant control approaches have been presented for conventional 
UAV formation flying, the time-varying formation control problem for the 
tail-sitters under flight mode transitions subject to multiple actuator faults 
and uncertainties is still unsolved. 

Motivated by these considerations, this chapter proposes a robust fault- 
tolerant time-varying formation control method for the group of tail-sitters 
subject to multiple actuator faults and uncertainties in the flight mode transi- 
tions. The actuator faults of each tail-sitter are considered as a constant loss 
of effectiveness in the moments and forces generated by the actuators, and 
multiple simultaneous actuator faults of the tail-sitter formation system are 
studied. For each tail-sitter, the designed controller is divided into an outer 
position controller and an inner attitude controller to govern the translational 
and rotational motions, respectively. The new contributions of the proposed 
control approach in this chapter are summarized as follows. 
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First, a continuous time-varying formation pattern can be achieved in the 
flight mode transitions without requirements of switching controller struc- 
tures or controller parameters. Second, each tail-sitter model considered in 
this chapter involves seriously nonlinear dynamics and high uncertainties 
involving parameter uncertainties and external disturbances. Third, the 
proposed distributed robust control protocol does not require identifying 
actuator faults online, and the effects of multiple actuator faults, parametric 
uncertainties, nonlinear and coupled dynamics, and external disturbances 
can be restrained simultaneously. The robustness properties can be guaran- 
teed for the global closed-loop control system. 


6.2 Problem Formulation 
6.2.1 Aircraft Body 


A schematic of the tail-sitter UAV is depicted in Figure 6.1. The vehicle is 
equipped with coaxial counter-rotating propellers to provide a dominant 
thrust or lift. Two wings are attached to the fuselage to generate enough lift 
for forward flight. Moreover, four small rotors mounted on the airframe tail 
and two ailerons situated at the trailing edge of the two wings simultane- 
ously take charge of the attitude control in the mode transition flights. 

Each tail-sitter can achieve the following three flight modes, as depicted 
in Figure 6.2. For vertical flight, the flight controller is similar to that of a 


Co-axial counter 


Ailerons — 


Rotors 


FIGURE 6.1 
Schematic of a tail-sitter aircraft. 
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quadrotor, i.e., the main lift force is generated by the coaxial counter-rotating 
propellers and the four rotors, while the attitude control is achieved by the 
differential force of the two pairs of rotors. In the forward flight, the domi- 
nant thrust is generated by the coaxial counter-rotating propellers and the 
lift is provided by the two wings. The yaw angle is controlled by the four 
rotors, while the pitch and roll angles are governed by the two ailerons. For 
the transition flight, in the initial phase of transition, the main lift is gener- 
ated by the coaxial counter-rotating propellers, while the lift generated by 
the wings is not dominant. Then, the vertical component of the thrust pro- 
vided by the coaxial counter-rotating propellers starts decreasing. As the for- 
ward flight speed of the vehicle increases gradually, the aerodynamic forces 
generated by the two wings become the dominant lift and can support the 
entire vehicle’s weight. In this case, the transition flight from vertical flight to 
forward flight can be accomplished. 


6.2.2 Dynamic Motion Equations 


In this chapter, two frames are defined: the inertial frame E! = lo! EEE) 
attached to the earth to analyze the tail-sitter motion and the body-fixed 
frame E? = lo? „ER EREE} attached to the tail-sitter body. 

From [84], the dynamical model of tail-sitter i can be given as 


mip = RiE,— M8C3 3, 
(6.1) 
Ji@;+ 0; Ji@;= Mit, 
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T " 
where p; - [pi Diy pi | is the position vector with pi representing the 


longitudinal position, pj, being the lateral position, and pj being the verti- 
cal position; m; is the mass of the tail-sitter; F and M; are the total force and 
the total moment acting on the tail-sitter, respectively, R; is the orientation 


matrix from EP? to E!, J; = diag {Jix, Ius Ji] is the inertia matrix, c,,; indicates 

an nx 1 vector with one on the j-th row and zeros elsewhere, g represents the 
m LA TP 

gravitation constant, @; = [oi Diy o: | is the angular velocity in E?, and 


the superscript x represents the cross product. Because the Euler representa- 
tion suffers from the singularity problem, the unit quaternion representation 
is applied to describe the rotational dynamics in the flight mode transitions. 


We define q; = [dio di F, where q; = [qa qi» dis ii and qio are the vector part 
and the scalar part of the quaternion, respectively, and satisfy 9; qi + qio = 1. 
Therefore, the orientation matrix R; by the unit quaternion is obtained by 


1- 204 = 245 20udi» — 24iodis 2duqis + 24ioio 
R; = 2qinqi2 za 2qiodi3 1- 204 T 205 2912413 = 2diodi 
2411913 — 2diodio 24i29i3 + 2qioqii 1- 2q = 205 


The relationship between @; and q; can be given as 


qi = 0.5970; + 0.5q:90;, 
gio = 0.500) Gi. 
In practical flight, the total force F; can be calculated as 
Ej = Fy + Fig + Fiy + Fig + Fa, (6.2) 


where F, is the total thrust by the four rotors, F, represents the thrust gener- 
ated by the coaxial counter-rotating propellers, F;, is the aerodynamic force 
by the fixed wings, Fy is the aerodynamic force generated by the fuselage, 
and F; indicates the external bounded disturbance force. The total moment 
M, can be obtained as 


Mit = Mi, + Ma + Mi, * Mi, * Mag, (6.3) 


where M; is the torque generated by the small four rotors, Ma represents the 
torque generated by the two ailerons, Mw indicates the aerodynamic moment 
generated by the fixed wings, M; is the gyroscopic moment generated by the 
high-speed rotation of the rotors, and Mj is the external bounded distur- 
bance torque. The thrusts F, and F, can be calculated as follows: 
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T 
ES ol 0 J „Fo=[koo2 0 of, (64) 


where k, and ki denote two coefficients, œ; is the rotor rotational speed, and 
@i represents the rotational speed of the coaxial counter-rotating propellers. 
The thrusts F, and F, satisfy Fo = k;F,, where k; is a positive constant. Fi and 
Fy can be described as 


(Là F Li2) sina; = (Da F Di )cosa; Ly sin &; — Dy cos Qj 
Fw QE 0 7 Fy zd 0 4 
-(Là + Liz) cos Qj; — (Da + Di»)sin O; —Li cos Qj — Dig sin a; 


(6.5) 
where L and Lp are the lift forces produced by the wings, Da and Dp are 
the drag forces generated by the wings, and Ly and Dy are the lift and drag 


forces produced by the fuselage, respectively. La, Lo, Da, Diz, Li, and D; can 
be given as follows: 


f «(st 
t «(0 


Ly = 0.5CiySyp((v8) +(02) , 


Ly = 05C, Sup ((o8 


Dy = 0.5C, 55,, o((v 


Di = 0.5CaSyp( (vk) * (v? j) j= 1, 2; 


where C;,1;, C; pj, Cip, and C; are the lift or drag coefficients, Siw is the main 
wing area, p is the density of air, and S; is the blade area. C; zj, C;,pj, Cip, and 
Cj; can be obtained as 

Cii = Cio + Cite Gi + Ciis Oj, 

Ci pj = Cipo + C? i/ Aip , 

Ciny = Ci, Oi, 

Ci af = Ci fo t+ Cr fa i, J=1, 2, 
where Cito, Citar Cite, Cipo, Cig, Ci fo and C; fa are the aerodynamic coef- 


ficients, 6, is the flap bias angle of the aileron, and Ap is a positive constant. 
M; is calculated according to 
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» ay (an + V2ajalin/2) 0; 
j=l 


Min 
Mi =] Mi» |= la [Fin + Fisa — Hs Fra |/2 , (6.6) 
Mirs lin [-Fin + Fir + Firs — F; r4 |/2 


where 4; and an are positive constants and l; represents the distance between 
two rotors. Mw can be given as follows: 


lj (Liz = Li )cos O; + lj (Di — Du )sin a; 
Mig, = lis (Liz + Lj) cos a; +l; (Di2 + Da )sin o 7 (6.7) 

lj (Liz = Li )sin O; + l5 (Da — D )cos a; 
where l; is the distance from the gravity center of the tail-sitter to the force 
acting position of the fixed wing and l; is the distance between the gravity 


center of the tail-sitter and the center position of the two wings. M; can be 
obtained by 


lC; L5Siwp Cosa; (C: y * (vz y ja, z ôn) 


Mia 
Mia =] Miaz |-| lisCirsSiwP cosa (c: n * (v? y ja, F 6) . (6.8) 
Mis 0 


Mi, can be calculated as follows: 


4 : 
My = Y, dotes (Cty oy, (69) 


where J, is the rotating inertia of each rotor. In the actual flight, the model 
parameters show deviation relative to theoretical values. All of the vehicle 
parameters are divided into two parts, for example, J; = JA + Jê, where the 
superscript N indicates the nominal parameter and the superscript A indi- 
cates the parameter uncertainty. Then, the dynamical model in (6.1) can be 
rewritten as 


m, pi =R Fi EN m? 8C3,3 + Ain, 
6.10 
NS ot xN ( 
Ji 6; =—-@; Ji 0; + Ma + Aj, 


where the uncertainty terms involving the parameter uncertainties satisfy 
^ AI A A 
Aim = —Mi 905,5 — Mi pi and Ay — —Ji'i — 0; J; 0. 
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6.2.3 Actuators 


The main control forces and torques of the tail-sitters are generated by four 
small rotors and two ailerons. Moreover, coaxial counter-rotating propellers 
are installed on the top of the airframe to generate the dominant lift force or 
the thrust force. 

The reliability of the tail-sitter is improved. For instance, if the rotors are 
damaged or have performance degradation, other actuators can still govern 
the octorotor flying. In practical application, the actuators may suffer from 
faults (partial loss or complete loss of the control forces and torques). The 
control moment M; generated by the four rotors and the two ailerons can 
be calculated by M; = Mi, + Mi. The force Fi. generated by the rotors and the 
coaxial counter-rotating propellers can be obtained by Fi. = Fi, + Fo. Therefore, 
Mi, and F; can be written as 


Mi, = Aula + Ans, 
Fi. = Aida, 


where Ui = [oA 02 O5 QA du Ui, = [5 6; 0 of, and 


Kiet Kio ki o1 —ki o1 
An = ki o2 Kiw2 —ki,o2 —k; o2 7 
—ki.os ki os ki os —ki.os 


kia -kia 0 0 
Aio = kin kiaz 0 0 7 


with Kia = li2Ci,LoSiP cosa, (vf y * (v2 y ) ki o1 = Aa + V2anln/2, Kia = 
10C; 13S p coso; (o8 y +(8)'), kio = Kili /2, kio3 = Kiln /2, and Kiyo = 
k; (14 ki). 

In this chapter, the actuator faults represent constant partial loss of effec- 
tiveness, which means that the faults are characterized by a decrease in the 


control moments and forces from their nominal values. Therefore, the actua- 
tor model can be written as 
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Tin = diag 10;,p1,0:,r2,0i,1340ira 


Dia = diag {Oi,a1,Ci,02, 0,0}, O',rjrO'i,ak € (0, 1], j= 1,2,3, 4, k = L 2; 


where 6;,,; and O;x represent the loss of effectiveness fault gain of the control 
moments or forces after faults. For example, o; = 0.3, which means that the 
control torque and thrust generated by Rotor 1 lose 30%. Then, the actuator 
model can be described as follows: 


Mi. = Mico = Anti na = Aiii, 
(6.11) 
Fe = Fico Ail; la, 


where M; o = Ail + AU and Fco = AU are the control moment and 
force without faults, respectively. 


6.2.4 Problem Statement 


Let B, = (m I and B, = UN J- We define up = R;Fico as the virtual position 
control input and uj, = M; co as the attitude control input. From (6.10), one can 
have the following system dynamics: 


Pi Bui, + Bi R (Fu, + Fy) — 8055 + Ai 


ip, 


(6.12) 
Oi = -B07 ]? o; * Bilin T Bi, (Mi, * Mg) F Ai, 
where Ap, Aj, are the equivalent disturbances and have the forms: 
Aip = B4R;F4 — B, R/AST im la + BipAim, 
(6.13) 


Ai, = B4 Mi — Bia (Alina + As ial ) + BiAy. 


The control objective in this chapter is to design a robust distributed fault- 
tolerant formation control protocol to achieve the aggressive time-varying 
formation flight under multiple actuator faults and uncertainties in the flight 
mode transitions. A virtual leader is introduced to provide the desired for- 


T 
mation flight trajectory. Let po =[ pro Pyo pio] e R?* be the bounded 
reference trajectory of a virtual leader, where its second derivative ji is 
assumed to be bounded and can converge to 0 in a finite time. We define 
T 
hy | h; hui hj] eR?" as the desired time-varying position deviation 
between tail-sitter i and tail-sitter j, which determines the time-varying for- 
mation pattern of the tail-sitter group. Let h; represent the position deviation 
between tail-sitter i and the virtual leader, satisfying hj = h; — hj. 
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Remark 6.1 


It can be observed that the tail-sitter dynamics includes serious nonlineari- 
ties, parametric perturbation, and airflow disturbances, as shown in (6.10) 
and (6.11), and is more prone to actuator fault effects. Therefore, it is chal- 
lenging to construct a robust fault-tolerant formation controller for a group of 
tail-sitters. By ignoring A;, and Aj, the model in (6.12) represents the nominal 
model. The real vehicle model can be regarded as the nominal model added 
with A;, and Aja. 


EE: See 


6.3 Robust Controller Design 


In this section, a robust distributed fault-tolerant time-varying formation 
controller is proposed for a team of tail-sitters, which consists of an outer 
position controller and an inner attitude controller for each tail-sitter. 


6.3.1 Outer Position Controller Design 


For tail-sitter i, the position control input u is constructed as including the 
following two parts: 


Up =Uiy + Up. (6.14) 


where uj; is the nominal control input and uj, is the robust compensating 
input. The nominal controller is constructed to achieve the desired formation 
control for the nominal translational system, while the robust compensation 
controller is constructed to restrain the effects of the equivalent disturbance 
Ai. The nominal controller is designed as 


i= -À, YW; Bs (K,(p! -pi- h;)- K, (pi -pj - iy) 


jeNi 
- AB ks (K, (pl -hi — ph) + Ko(p! -h = pi) (6.15) 
- Ri (Ew + Fy) + By ges + By În, 


where A, indicates a positive coupling gain, K, and K, are the nominal con- 
troller gain matrices, and k; is the connection weight between tail-sitter i and 
the virtual leader. k;, » 0 means that tail-sitter i can access the information of 
the virtual leader; otherwise k;, = 0. 

Furthermore, uj, is constructed to overcome the influence of the multiple 
actuator faults and uncertainties. In (6.13), one can see that the influence of 
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the multiple actuator faults and uncertainties is considered in A;,. Because A; 
involves multiple uncertain terms and thereby cannot be measured directly 


in practical applications, the robust filters F; (s) = diag|F, ji (s), Fi, (5), F, ps (s)} 


are introduced here, where E, p (s) = f?;; / ( S+ fiy y ( j=1, 2, 3),sis the Laplace 
operator, and f, ,; is a positive robust filter parameter. Therefore, we design 
the robust compensating input uj as: 


us (s) = By Fp (s) ^s (s). (6.16) 


One can observe that robust filters have the following property. 
E, (s) (j 2 1, 2, 3) have wider frequency bandwidths by selecting larger 
robust compensator parameters f, y; ( j=1 2, 3). Then, the robust filter gains 


are closer to 1. In this case, the influence of the equivalent disturbance Aj, can 
be restrained. In (6.12), one can obtain that 


Ap = pi - Byui, — BipRi (Fu *E ) + $55. (6.17) 


From (6.16) and (6.17), the robust compensator can be realized as follows: 
Tij fina = fopi + Bipi + BpR;i (Fu F Fy)- 803,37 
Ni,p2 = — fpi, p2 T 2 fpi T Tipi (6.18) 
ui z By fp (nio E pi), 

where N; pı and n; p2 are the filter states and fi, = diag( fupi, fip, fips): 


6.3.2 Inner Attitude Controller Design 


The attitude controller of each tail-sitter is designed using only the informa- 
tion of itself. Define the attitude tracking error e; as 


€i = [eio Cia f = [7 Qj — o; i " (6.19) 


where Qis a nonlinear function and ø? is the desired angular velocity. Denote 


the desired attitude reference as qj =[qio dà qi Gal's The nonlinear func- 
tion Q can be given as follows: 


—qioqa + qaqio + Finis — diadio 


A r 3 r r r r r 
Q(qi,qi ) = 2sen( Xa —tQioqi2 — filis + Qi2dio + qi 
—qioqi3 + didi — Fi2gir + GisGio 
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The desired angular velocity o; can be obtained by @; = 


x T 
os| -ar (als -(a) | Je. From [120], the error dynamics of the attitude 


= SHE 
system can be given as éj, = [o -0i Qi- à; | Ă 


Similarly to uj, the attitude control input u; can be designed with two 
parts: the nominal control input u] and the robust compensating input uk, 
as follows: 


Ua =U] + uk. (6.20) 
We design the nominal control input ui as follows: 
un = Bu (-K;eio re Kei T ài )* oi JNO; 23 Mig, un Me, (6.21) 


where K, and K, are diagonal positive gain matrices. One can construct the 
robust compensator 1/; as 


us (s) = —Bi Fa (s) A; (s), (6.22) 


where Fa (s) = diag (Fim (5), F;,a2 (8), F;,a3 (5)] and E,s(s)- feu /(5+ - 
( j=1,2,3). The realization of the robust compensating input uj; is similar to 
that of uj. 


Remark 6.2 


One can see that the designed controller is continuous in the flight mode transitions, 
without any switching requirements on the coordinate systems, controller structures, 
or controller parameters. Moreover, the proposed fault-tolerant time-varying forma- 
tion control strategy is distributed because the designed control law of each tail-sitter 
depends on the position and velocity information from its neighbors and itself. 


6.4 Robust Property Analysis 


In this section, the robustness stability and tracking properties of our overall 
constructed control system can be guaranteed in the presence of actuator 
faults and multiple uncertainties using the small gain theorem. 


We define the position tracking error as e? = pi - hi - po. Let ej = 


T 
(e) (2) | . According to (6.12), (6.15), (6.16), (6.21), and (6.22), one has that 
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Apep- i, Bu >, 09 (Ky( (e? -e7) +K, (é Ea) 


jeNi 
— Ask Ba (Kye? + Ka6? + Ba (Bus As + 0), (6.23) 
Cin = Agti; + Ba (Bau + Ain), 


where 


Thus, the global closed-loop error system can be written as 


by = Apep + Bio (Bitlis + Ap + po), 
(6.24) 
ea = Ala + Bio (Bau + Aa), 


where e, = [ep] e RIN”, e = [en] e RÉP, and 


Ap = IN ® A, —A,(L+B,) 8 B,K;, 


A, = ÎN O As, Br = În 8 Ba, 


with B, = diag {ki be RN and K, -[K, K, } One can observe that the 


matrix A, is asymptotically stable by choosing proper gain matrices K, and 
Ko. From [120], if the directed graph G involves a spanning tree and there 
exists a root that can receive the information from the virtual leader, the 
matrix A, is asymptotically stable, if A, > 0.5Apm, where Apm = min Re(Aip ) and 
Ai is the eigenvalues of (L+ Bj ). 

From (6.24), one can obtain 


fe] S xoxo + zoo, + Zo |l]. 
(6.25) 


leale < aol + ZallAal 


L 
where A,= [Ai | eR and  A,-[A;,]e RP", mps e^"e, (0), 
Bi; (Ia -F »(s)) K Xpo = (slo -A a Br / 
Ka =|(slen — A. n Bo( Ian — F,( (s))| p Xo = max j|p,;( t), F,(s) ) = diag (F; (s yt and 


F, (s) = diag{Fi,(s)}. From [49], there exist positive constants f; and f; such 
that if fom 2 fp and f, Z fa, then one can have x; S As Toss Xa S Au) fam and 


l 


Tao =2e^"ea(0), Xp= l Sle — Ap 
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Xpo S Apo, where fom =minj{ f; jj], fom =min;{ fia (j 1, 2, 3), and Ap, Aa, and 
Apo are positive constants. 


Theorem 6.1 


Consider the tail-sitter formation system described by (6.1) and the robust 
formation control method in Section 6.3. If the directed graph G has a span- 
ning tree, the root can receive the information from the virtual leader; 
then, for the initial bounded conditions, e, (0) and e, (0) and given positive 


constants £, and £,, there exist positive constants p^ y, Fis T,, and Tý, such that 
if fin > f; (j - 1, 2, 3)and f, 2 f, then the time-varying formation flight of 
multiple tail-sitters can be achieved and the tracking errors are bounded and 
satisfy that max, e;,p; (t) S £p, VEZ T; and max; e;,j (t) Eg, VEZT,. 

Proof 6.1 From (6.13), one can have that 


^ As 
Ap | Bpl) RAT ina + RiFig + m; 903,5 + mi Di " 


loo 


Bi, 


A 1 


(6.26) 
S Ai api 


lus 


Lt Xi,dp2 


where Aia and A;,4,2 are positive constants. Combining (6.15), (6.16), and 
(6.14) leads to 


Uip 


" + Ai up2| 


A; 


" < Aun E ip s + Ai, ups (6.27) 
where A; apt, Ainp2, and A;,5 are positive constants. Combining (6.26) and 
(6.27) yields that sii i 

6.27) yields that 


A 


s Ai ul 


ip e, + A Ai 


It follows that 


Asl, S Ana 


ey] Ao, (6.28) 


where A4,; = max; A; and A? = max; Aj,au2. One can see that if fym 2 fo, 
such that fom > 44,14, the following inequalities hold 


Au || 


n Loo) + Asu2 
1- Asa on i 


Tpo 


la]. s 


(6.29) 
2 LN F XpoXo F Anup fom 


7 i= And x 


pJpm 


ep 
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Since the second derivative pp of the desired trajectory of the virtual leader is 
bounded and converges to 0 in a finite time and the matrix A, is asymptoti- 
cally stable, there exist positive constants £4, and £ such that 


AL S £x» 
(6.30) 
leo, S £o 
From (6.25) and (6.30), one can obtain that 
max; con, jep (t) < max; Ce, po + XpoXo + fomApEnp- (6.31) 


In (6.31), for a given positive constant £,, there exist a positive constant T; and 
a positive parameter pas such that if f; 2 f ( j=1, 2,3), the tracking error is 
bounded and satisfies that max; eip; (£) SE YET}. 

According to (6.13) and (6.19), one can obtain that 


Al. S Balh Anli ala + Alia Uz], 
+ Ball 0J a, +8], 726: + Bal; lMal.. (6.32) 
< Ài, luis. + Ai, pa lle; lE. + Ai, a3 leall, + Ài an4, 


where À; 411, Ai, m2 and À; m3 are positive constants. 
According to (6.19), (6.20), (6.21), and (6.22), one can have that 
+ Bal 


loo 


Min «lor Jo; 


n 1 [Keio E Kui, bo 


+B + Bio! + Mw + Mi (6.33) 


Aia 


L lea. 


+ Ài us || Ais + A tad, 


L 


< Ai ust lel. + Ài,ua2 leis 


L 


where Ai ua Ài;u2; Ai u3, aNd Ài, m4 are positive constants. Combining (6.32) and 
(6.33) leads to 


3A; is; (6.34) 


L 


[Aall < Aiae leal? + Ai, ea |leia 


where À; [ey Ai,ac2, and Àj, are positive constants. It follows that 


JA]. < Anei lle] + Anca les]. + Ares, (6.35) 


where A444 = max; Ai ad, A2 = MAX; Aj, ae2, aNd Ases = MAX; Aj, e3- 
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If the following inequality holds 


Anei Pal. Ano S1/( Ja + Xa), (6.36) 
one can have the following equation by combining (6.25) and (6.35) 
cll, S ao] za +(1+ s Ases. (6.37) 
From (6.25) and (6.37), it follows that 
les], S Tao * Va Aea, (6.38) 


where Aa > 7,9 Halen (1+ Xa Aes: For (6.36), one can obtain the attractive 
region of e,(t) as 


-1 
leu (6): ul < Aah (eee s) - Aaa (6.39) 
From (6.37) and (6.25), one can have that 


+ y fom Aa Aen: 


T T 
max;|céy, je; (£) < max; [Cn a0 


From the above analysis, it can be observed that for a given positive constant 
£, and the given initial condition, there exist a positive constant T; and a posi- 
tive parameter f,, such that if fiaj 2 fa ( j= 1,2,3), the tracking error of the 


translational system is bounded and satisfies that max; e; aj (£) Eg, VEZT,. 


Remark 6.3 


The influence of the multiple faults in actuators is included in the equiva- 
lent disturbances in Ap and Aj,, which can be restrained by the constructed 
fault-tolerant formation controller with no need for any fault knowledge. 
Furthermore, the influence of nonlinearities, parametric perturbation, and 
airflow disturbances can be restrained by the designed distributed control- 
ler, simultaneously. Moreover, the trajectory and attitude tracking errors of 
the global closed-loop control system can converge into a given neighbor- 


hood of the origin ultimately by selecting proper fi, and fiaj ( j=1, 2, 3). 


6.5 Simulation Results 


In order to verify the effectiveness of the proposed fault-tolerant forma- 
tion control method, multiple tail-sitters are simulated under the influence 
of multiple actuator faults and uncertainties. Four tail-sitters (tail-sitter 1, 
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tail-sitter 2, tail-sitter 3, and tail-sitter 4) are considered in the formation. For 
the tail-sitter formation system, the following fault modes are considered: 
Tail-sitter 1 and tail-sitter 3 have no faults, and tail-sitter 2 and tail-sitter 4 
suffer from actuator faults at 12s, simultaneously. For tail-sitter 2, all actua- 
tors are subject to a 30% loss of effectiveness. The failure models can be given 
as 


j 0, O<t<12, 
Onw Ozal) o3 i212 k=1,2,3,4, j=1,2 


For tail-sitter 4, Rotor 4 is completely stuck and the two ailerons are subject 
to a 24% loss of effectiveness in the control torque, respectively. The failure 
models can be given as 


0, 0«t«12, 
O4;,4— 
1, t212, 


i 0, O<t<12, 
CupOiu()-7| o», 1212, j=1,2,3k=1,2. 


The trajectory of the virtual leader is given as p;o = 0, and 
0, t€ 10, 


Pxo71 £-20t4100, 10«t € 20, 
20t - 300, t > 20, 


t, t€10, 


Po] 49. 302125010} „t>10. 


Each real vehicle parameter is assumed to be 25% larger than its nominal 
value, respectively. The time-varying external disturbances acting on tail- 
sitter i are given by 


11.2sin(2t)+15.8cos(t) 
Fa=|  13sin(3t)+21cos(3t) |, 
5.6sin(t)+27.5cos(2t) 


8.5sin(2t) + 3.6cos(2t) 
Ma-| 10.6sin(t)+7.3cos(3t) 
13.4sin(2t) + 9.7 cos(3t) 
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The nominal controller parameters are chosen as K, = diag {130,120,120}, 
Ku =diag {105.3, 100.8, 100.8}, K, =diag {3.5,3.5,3.5},and K, =diag {1.5,1.5,1.5}. 
The robust compensator parameters are chosen as f;,, = 1000, f; p2 = 1000, 
ip =1000, fim = 50, fia2=50, and fiag = 50. The directed communica- 
tion topology is selected as the node set V={v1,v2,03,v4}, the edge set 
E = {(04,03),(03,02),(02,01)}, and the weighted matrix W - [w;; ] with 0-1 
weights. In the task, tail-sitter 4 is considered as the root of the directed 
graph; thereby, kış = 1, ky, — 0, k3, — 0, and ka, =0. In order to achieve the 
time-varying formation flight, the desired deviations of the four tail-sitters 
can be chosen as 


[o 4 o[,r«10, 


h, = 

[o 5-e*™ of, r«10, 
[-4 0 0], t<10, 

h» = 

“| [ae o of, #10, 
[o -4 o[,t«10, 

ha = 

"| [o e*9-5 of, rs, 
[4 0 o[,t«10, 

h, = 


faa 9 10-10&79T, ¢< 10. 


The simulation results for the time-varying formation pattern subject to com- 
munication delays and multiple uncertainties using the proposed control 
method are depicted in Figures 6.3-6.5. Figure 6.3 depicts the trajectories 
of the group tail-sitters. The attitude and position response are shown in 
Figures 6.4 and 6.5, respectively. Furthermore, a baseline nominal controller 
developed from [116] is implemented for comparisons. The tracking errors of 
the position by the two control methods are compared in Figures 6.6 and 6.7, 
respectively. From these results, one can see that the position tracking errors 
using the proposed controller are smaller than the baseline nominal control- 
ler, and the attitude tracking performance by the proposed controller can be 
recovered back to normal response quickly when the faults occur. Moreover, 
the real formation trajectories by the baseline nominal controller deviate 
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FIGURE 6.4 
Attitude response using the proposed robust controller. 
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Position response using the proposed controller. 


from the desired trajectories. However, the proposed controller can achieve 
the predefined time-varying formation scenario. The proposed robust fault- 
tolerant formation control method can restrain the effects of the multiple 
actuator faults, parametric perturbations, coupling, nonlinear dynamics, and 
external disturbances simultaneously. 
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6.6 Conclusion 


In this chapter, a robust distributed fault-tolerant and continuous time- 
varying formation control approach is proposed for a group of tail-sitters 
subject to multiple actuator faults and uncertainties in aggressive flight mode 
transitions. For each tail-sitter, the proposed controller can be divided into an 
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Trajectory tracking errors using the baseline controller. 


inner attitude controller and an outer position controller. The controller can 
achieve the time-varying formation flight in the flight mode transitions with 
no switching requirements on the coordinate systems or the controller, and 
the information of the actuator faults does not need to be identified online. 
Furthermore, it is proven that the stability of the proposed global closed- 
loop system can be guaranteed in the presence of multiple actuator faults 
and uncertainties. The simulation results demonstrate the effectiveness of 
the proposed fault-tolerant time-varying formation control method. 
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